U/19/ 01 16:11 FAX 2 12 575 0671 



COWAN , LIEBOWITZ & LATMAN 



77 Rec'd PCT/PTO 1 9 NOV Z001 



ATTORNEY'S DOCKET NUMBER 
141/02497 



■TO-lisi) (Modified) O-St DJurAKTMBNT Of COMMfifcCE VATENT *X» WPCMtflK OIEKTE 

Transmittal letter to the united states 

DESIGNATOP/BLBCT5P OFFICE (DO/EO/US) 
CONCERNING A "FILING UNDER 35 U.S.C. 371 



US-APPLICATION NO- («■- K.NOW^Sbli 37£H" 



n9/926547 



INTERNATIONAL APPLICATION NO. 
PCT/1L99/00479 



| INTERNATIONAL piling date 
September 5^ 1999 



PRIORITY DATE CLAIMED 

3Vfoy 19, 1999 



TTTLE OF INVENTION 
IMAGE COMPASSION 



A,ppUCANT<S) FOR DO/EO/US 
A.viraiu SaKTJBL, et al. 



pplicani herewith subtisite tc the United States Di*fottied/Eleend Office (DO/EO/US) the fallowing tens aiid oi 
1, E This is a, FIRST submission of iiems concerning a Sling under 35 TJ.S.C. 371- 
V □ This is 3 SECOND or SUBSEQUENT submission of items concerning a filing under 35 U.S.C. 371 , 
3. S This is sm express request to begin national c: 



must include iKnS (5.1, 



.,.__,.„ (35U.S.C.371(£)).Thcsi 

(<J)7(9) and (24) indicated below, 
H The US has been elected by tho expiration of 19 months from The prloriry daie (Article 31). 
13 A copy of the International Application as filed (35 U.S.C, 371 (c) (2)) 

a. □ is attached hereto (required only if not communicated by the Lnternaiioiaal &ure$n). 

b. S has been communicated by the Inwrnalional Bureau. 

c. □ is not required, as the application was filed in the United States Rraciving Office (RO/U5). 

□ An English language nrmslfitjqa of the totcinarional Application as filed (35 U-3-C. 371 (c)(2)). 

a. □ i* attached hereto. 

b. □ has been previously submitted wider 55 U.S.C. 154(d)(4). 

□ Amendments to the claims of the International Application under PCT Article 1 9 (35 U.S.C. 371 (c)(3)) 

a. □ arcattached hereto (required only if net communicated by the taxational Bureau). 

b. □ have b«en eommunicaied by the International Bureau. 

c. □ have not been made; lowcvcr, tke time llmli for making such arnendinoiita has MOT expired, 
d- □ bavttnotheenraadearitJwilli»otbBrr«dB. 

□ An English language translation of the amendmimtB to the claims under PCT Article 19 (35 U.S.C. 37I(c)(3)J. 
. m A.n oath or declaration of the inventor(s) (35 U.S.C. 371 (e)(4)). ilrJ&iteC-4T&& 

□ An English language translation of the annexes [q the International Preliminary finsminaTion Report under ?CT 
Article 36 (35 V-S.C. 371 (c)(5)). 

H A copy of the Intcmfttioniil Pielhriiriary Examination 'Report rKTYlPEA/409). 
S A copy of the International Search Report (PCT/ISA/210). 
Items 13 to 20 below concern documents) or inlorniacion included: 

An Information Disclosure Statement under 37 CFR 1.97 and 1-98. 

An assignment document for recording, A separate cover sheai'in compliance with 37 CFK 3.2S and 3.31 ie included. 
A EOfcST preliminary amendment 
a SECOND or SUBSEQUENT prelirahiHry amcndincnt 
A substitute specification. 

A ehange of power of attorney and/or address letter. 

A computer-readable form ofthe sequence listing fo accordance with PCT Rule 13ier,2 and 35 U.S.C, 1.823 - 1.S25. 
A second copy of the published international application under 35 U.S.C. 154(d)(4). 
A second copy of the English language Translation of the intertifirion&l application wider 35 U.S.C. 154(d)(4). 
Certificate of Mailing, by Express Mail 
Other items or information: 

1. Copy of PCT71B/30S Notice 

2. Amendments to the claims of the International Appliffttion under PCT Article 34 are attacnea u ercto as annexes it 
tiie 1PER- 



13. 


a 






15. 




IS. 


□ 


17. 




"5. 




IP. 




20. 


□ 


21. 




22. 


□ 


23, 





NOU 19 '01 15:03 



212 575 0671 PAGE. 003 



11/19/01 16: 11 FAX 21 2 575 0671 



COWAN , LIEBOWITZ & LATMAN 



@004 



09/926547 



US. APPLICATION NO- (IF JSKOWN, SEE 37 CFR 



PvTTERNATIONAL APPU'CATTOW NO- 
FCT/IL99/0O479 



381 toft PCT/PTC 18 N OV 201)1 



ATTORNEY'S DOCKET NUMJSHR 
141/02497 



-J4 The fallowine fees are submitted:. 




CALCULATIONS PTO USE ONLY 


BASIC NATION AX FEE ( 37 CFR 1.492 (a.) (1) - (5)) : 

D Neither intern^ional preliminary examination fee (37 CfR 1.4S2) nor 
international search fee<37 CFR I.445Ca)C2V)pflid to USPTO 

B Intemaiional preliminary examination fee p7 CFR. 1.4S2)not paid to 

USPTO but International Search. Report prepared by the EPO or JFO SSPO.O" 

i~l Inteni&TionalprelkriiiiarYCXBrjM 

"taraalionia search fee (37 CFR 1 WfrX^ P*d* US'tfb S740.00 

□ International preliminary examination fee (37 CFR 1.482) -paid to USPTO 

* 3 International preliminary examination fee (37 CFR 1 .4S2) paid to USPTO 

ENTER APPROPRIATE BASIC FEE AMOUNT - 




SS90.00 




Surcharge: ofS13Q.QO for furnishing the oath Of declaration Idler than □ 20 □ 30 
months &om the earliest claimed priority date (37 CFR 1,492 C=))- 


$0.00 




CLAIMS 


NUMBER HLED 


NUMBER EXTRA 


Rate 




Total claims 


47 . 20 = 


27 


x S18.00 


$486,00 




' J "iT "" 

Independent claims 


3 ~ 3 = 


0 


x $84.00 


S0,O0 




Multiolo Dcocndent 


Claims ( check if aoDlleabW. 


□ 


SO-00 




TOTAL OF ABOVE CALCULATIONS = 


51,376.00 




i*f Applicant claims small entity status. Sea 37 CFR 1.27), The fets indicated above arc 
'.- rcduttd by U2. 


S688.00 




O SUBTOTAL = 


$688.00 




(llcB£ringfBBof$13Q.Q0foTfurm5limg^ O20 □ 30 
raSSrithS frc-m the earliest claimed priority date (37 CFR 1 (f))- + 


$0.00 




ni l TOTAL NATIONAL FEE = 


$<S$$,QQ 




tie for recording fh,c enclosed assignment (37 CFR 1.21(h))- The assignment must be 
aSSompanied by an appropriate cover sheet (37 CFR. 3.2B, 3.3 1) (check if applicable). 


□ 


so.oo 




.r- TOTAL FEES ENCLOSED = 


SS88.00 






Amount to tws 
refnniled 


S 


charged 


5 



M a. D A Check in (he amount of to cover the above fees i£ enclosed. 

Planse charge my Deposit Account No. 0 3-3419 in the amount of s68ft.flfl 



A duplicate copy of this sheet is enclosed. 

Tlie Commissioner is hereby authorized to charge any additional fees which may be requited, o 
to Deposit Account No. 03' 



^ A duplicate copy of this sheet is enclosed. 



to cover the above fees, 
credit any overpayment 



□ Fees are to be charged to a credit card. 'WARNING: Information on this form m»y become public. Credit card 

information should not be included on this form. Provide credit card information and authori2ation on PTO-203S. 

NOTE: Where an appropriate time limit underS? CFR 1.404 or 1.495 has not been met a petition to revive (37 CFR 
" 137,60 or (b)) must b« filed and Rrantod to restore the application to pending status, 

SEND ALL CORRESPONDENCE TO: 

William EL Dippcrt, Esq. 
Cowsin, Licbowite an«3 Laiman, P-C. 
1133 Avenue of the Americas 
New York, NY 10036-67P9 



Tds (212) 7°o-!>200 



SIGNATURE 

Vval FENSTER. 
NAME 

33,817 

REOJ5TRATTQN NUMB8R 

November is, 2001 



NOU 19 '01 15:03 



212 575 0671 PfiGE.004 



_11/ 19/01 16 :12_FA^_212 575 0671 COWAN , LIEBOWITZ & LATMAN 0006 

_ 09/926547 

141/02497 A01 WlfltftfPCT/PTC 19 NOV 2001 

UN THE UNITED STATES PATENT AND TJRADEMARK OFFICE 

Applicant: A. S ARIEL, et al. 

Serial Number: Not yet assigned 

f ile d; 05 September 1999 as PCT/TL99/00479 and Herewith as US National 
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For: Image Compression 
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Honorable Commissioner of Patents and Trademarks 
Washington DC 20231 

PRELIMINARY AMENDMENT 

Sir: 

Further to the rancuxrcnt filing of a U.S. national stage application of PCT Application 
H No. PCT/IL99/00479, kindly amend the application as follows: 

*! IN THE SPECIFICATION 

rrjf Kindly add the following section on page 1 , immediately after the ride: 

5 -RELATED APPLICATIONS 

* This application is a U.S. national filing of PCT Application No. PCT/IL99/Q0479, filed 

September 05, 1999.- 

l}_ IN THE CLAIMS 

O 

1 " Kindly delete claims 2-3. 5-7, 9-10, 13^ 17, 20, 25^3, 3^7, 42^43, 50, 52-54, 56, 5S-S9 ; 61- 

62, 68-69, 71-73, 75-76, 79, 81, S2, 84-89. 91, 92„ 94, 97-99, 101-102 without prejudice. 

Kindly replace present claims 4, S, 11, 21-24, 34, 36, 38, 44-46, 48^19, 51 . 55. 57, 60, 63- 
66 3 70, 74, 77, 83, 93, 95-96 s 1 00 with the following claims in clean form: 

4. (Amended) A method according to claim 1, comprising matching Said conthmons ccniponeni 
to a discretization behavior of said discrete sampler using a matching component. 

8.( Amended) A method according to claim 1, comprising compressing or decompressing said 
data using a transform-type compression/decompression method that uses said transforming- 
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11 .(Amended) A method according to claim 8, wherein said transforming comprises transforming 
using one or more optical elements which, perform a block transform. 

21. (Amended) A method according to claim 8, wherein said compression is a JPEG compression. 

22. (Amended) A method according to claim 8, -wherein said compression is a MPEG 
compression- 

23. (Amended) A method according to claim 8, wherein said compression is a wavelet 
compression. 

24. (Amended) A method according to claim. 8, wherein said data represents an image sequence. 

34. (Amended) A method according to claim 1, comprising post-processing said data to generate 
data that represents a transform other than a Fourier transform. 

36. (Amended) A method according to claim 34, -wherein said postprocessing comprises spatially 
modulating said light. 

35. (Aniended) A method according to claim 34, wherein said preprocessing comprises mirroring 
said data. 

44. (Amended) Apparatus according to claim 40, wherein said processor performs at least some of 
its processing on optic waves, 

45. (Aoicnded) Apparatus according to claim 40, wherein said processor performs at least some of 
its processing on electronic signals. 

46. (Amended) Apparatus according to claim 39, comprising an optical motion estimator, 

4S.(Amended) Apparatus according to claim 46, wherein, said optical motion estimator includes a( 
least one electronic component 

2 
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49. (Amended) Apparatus according to claim 39, comprising an. optical motion, compensator, 

51. (Amended) Apparatus according to claim 49,. wherein said optical motion compensator 
includes at least one electronic component. 

55 , (Amended) Apparatus according to claim 39, wherein said data comprises an image sequence. 

57,(Amended) Apparatus according to claim 39, wherein said data is manipulated as blocks. 

60.(Amended) Apparatus according to claim 39, wherein said optical component comprises a 
holographic lens. 

«==: 63 .(Amended) Apparatus according to claim 39 f wherein said optical component comprises a 
Cl matrix product calculating element. 

ffs 64.. (Amended) Apparatus according to claim 39, wherein said light source comprises a binary 
W SLM (sp atial light modulator). 

~ 65. (Amended) Apparatus according to claim 39, wherein said input is matched to said output to 
fz account for non-point light sources and detectors. 

in 66,(Amended) Apparatus according to claim 39, wherein said apparatus processes a plurality of 
Tt data blocks in parallel. 

70.(Arnendcd) Apparatus according to claim 66, comprising light attenuators arranged to attenuate 
light leaking between areas processing different data blocks. 

74. (Amended) Apparatus according to claim 39, wierein said optical component comprises a bi- 
refi-ingent material. ; 

77. (Amended) Apparatus according to claim 39, wherein said input receives light waves from an 
imaged objeci and wherein said input spatially samples said light. 
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83.(Amended) Apparatus according to claim 77, cohlprising & storage -unit for storing at least one 
set of said electronic signals, corresponding to an image sequence. 

93.(Amended) An element according to claim 90,' wherein said optical groups perforin said 
transforming using a. discrete optical component ihari applies a traasfoim 

95, (Amended) An element according to claim 90, Wherein said, at least one sub-element comprises 
a lenslet array portion. ■ '; 

96 .(Amended) An clement according to claim 9Qj wherein said plurality of optical groups are 
arranged as a matrix, ] \ 

100,(Amended) An element according to claim 9,0. wherein said transform comprises a non- 
separable transform. • ! . 

The present application is a U.S. national application of PCT Application No. 
L, PCI7IL99/00479 filed September 05, 1999. -\ \ 

The present amendments are based on the claims attached to the IPER. Claims 4, S, I I, 
21-24, 34, 36, 38, 44-46, 48-49, 51, 55, 57, 60, 63166, 70, 74, 77, 83, 93, 95-96', 100 have been 
i ? amended, and claims 2-3, 5-7, 9-10, 13, 17, 20, 25-33, 37, 42-43, 50, 52-54, 56, 58-59, 61 -62, 68- 
69, 71-73, 75-76, 79, 81-&2* 84-89, 91-92, 94,] ;97-99, 101-102 have been canceled. The 
amendments were made to limi t the number of claims and remove multiple dependencies, to 
reduce costs and put the claims in better form for examination in the US. A typographical error 
was also corrected, i. ', 

After amendment, the present application contains claims 1, 4, 8, 11-12 7 14-16, 18-19, 2 l- 
24, 34-36, 38-41. 44-49, 51, 55, 57, 60, 63-67, 70, 74, 77-78, SO, S3, 90, 93, 95-96, 100. 

It is noted that the claims wore indicated as meeting the criteria of PCT Article 33(2)-33(4) 
in an International Preliminary Examination Report issued by the European Patent Office (acting 
aslP£A). 

4 . ; 
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A markcd-up set of the amendments is attachssd hereto- 
An examination on the merits is respectfully requested. 



November 1 8, 2001 



William H. Dippert, Eaq. 
Cowan, Lisbowitz and Latmajti, P.C. 
1 133 Avenue of the Americas 
New York, NY 10036-6799 

Tel: (212)790-9200 



Respectfully submitted, 
A. SAMEL, et aL 

Paul Fenater 
Reg. No. 33,877 
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Marked-Up Version of Amendments 



CLAIMS 



4.jtA£aended) A method accoiding to claim l a ny - of claims 1 - 3 . comprising matching said 
eeHSBHes-cojiti-nuoaa component to a discretization behavior of said discrete sampler using a 
matching component. ; 

g. (Amended) A method according to claim l a riv or olaima I 7, comprising compressing or 
decompressing said data using a transform-type -compression/decompression method thai uses 
said t^sforrriing. 



1 L jAmended) A method according to claim_ Smly of otoims S 10 , wherein said rransfonning 
comprises transformmg using one or more optical! elements "which perform a block transform. 



21. (Amended') A method according to claim Sa t 
a JPEG compression. 



5-20 , wherein said compression is 



22 , f Amended) A method according to claim 8a 
a. MPEG compression. 



, wherein said compression is 



23 J Amended) A method according to claim, .8a * 
a wavelet compression. 



^ wherein said compression is 



24. (Amended) A method according to cjgjrnj ito^' of oloieaa- S -20, wherein said data represents 
ari image sequence. [ 

34.jAmended}A method according to claim T arty of claims 1 7 or 38 33, comprising post- 
processing said data to generate data that represents a transform other than & Fourier transform. 



36. f Amended) A method according to claim 34| or- etot m 35 , wherein said postprocessing 
comprises spatially modulating said light [ 
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38-iArneTsded) A method according to claim 3 *1 n tiv of r ln imn 1 1 ^7 /whcrcin said preprocessing 
comprises mirroring said data. ■ J 

44 (Amended) Apparatus according to claim 40 'jor claim 4 1 ; wherein said processor performs 
5 at least some of its processing on optic waves. ; ■ , 

.{■, 

45 /Amended) Apparatus according to claim 40 'a nv of claims 4 0 1 1, wherein said processor 
performs at least some of its processing on electronic sigpals. 

10 46. (Amended) Apparatus according to Haim ^Onny nf olaima 1Q comprising optical 
motion estimator- ,{ 

4S. { Amended) Apparatus according to claim 4 6' or olaim 17 3 wherein said optical motion 
,_, estimator includes at least one electronic component. 

C 49. fAmend.ed) Apparatus according to claim 39 'mrv of clainis -- 3 n - "4 ?, comprising an optical 
motion compensator. 

I ..i 

71 51. (Amended) Apparatus according to claim 4 ^ or claim - - 50 , wherein said optical motion 
20 compenaator includes at least one electronic component. 

J== 55. f Amended) Apparatus according to claim 39 any of nlaimc 39 5 A , ■wherein said data 
\f : comprises an image sequence. ; ; 

25 5 7 / Amended) Apparatus according toj* claim 3.9 ony of olaima 30 56 , wherein, said data is 
manipulated as blocks. j 

60. (Amended) Apparatus according to ^laim ? <Jnny nf nlni-mn 3n gQ n wherein said optical 
component comprises a holographic lens. ' j; 

30 'i 

I;' 

63 /Amended) Apparatus according to claim 39 onv of claj a nG 39-63. wherein said optical 
component comprises a matrix product calculating element. 
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64. (Amended> Apparatus according to claim 3! 
comprises a binary SLM (spatial light modulator)^ 



65 . CAmendedt Apparatus according to claim 31 



$ matched to said output to account for non^point light sources and detectors. 



66 /Amended! Apparatus according to claim ?_ fta ny of - ctoircno 39 65 , wherein said apparatus 



processes a plurality of data blocks in parallel. 



10 70 / Amended 1 ) Apparatus according to claim 



r, -wherein, said light source 



■ of olabrts— 39 -64, wherein said input is 



6 6anv of- 



66 69 -, comprising light 
attenuators arranged to attenuate light leaking between areas processing different data blocks. 

74. ( Amended 1 ) Apparatus according to claim 39 nnv - ef - efloima 39 73. whereto, said optical 
component comprises a bi-refxingent material. 



77. ( Amended^ Apparatus according to claim 3l9 nnv of claims - 39 76 , wherein said input 
receives light waves from an imaged object and wherein said input spatially samples said light. 



83 . ( Amended') Apparatus according to c]aim_7_7 i 



lo for storing at least one set of 3aid electronic signals, corresponding to aai image sequence. 

93. ( Amended') An element according to claim ^g Q any of alaima ■ 9f> 93, wherein said optical, 



groups perform said transforming using a discrete] optical component that applies a transform. 



•5 95 .r Ajn ended) An. element according to claim 9 0'o bv of olnirna 90 PI. wherein said at least one 
sub-element comprises a lenslet array portion. 



l 77 SI, comprising a storage unit 



96, f Arricnded^) An element according to claim 9Q c mv of slaima 90 95 . wherein said plurality of 
optical groups are arranged as a matrix. 

1 00. (Amended) An element according to claim 90 nnv of claims QQ 90 . wherein sirid 

transform comprises a non-separable transform. ! 
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TMAHF COMPRESSION 
FIELD OF THE INVENTION 

The present invention relates to the field of optical processing and especially to 
compressing images using optical components. 

BACKGROUND OF THE INVENTION 
Often, the information bandwidth to be transmitted is greater than the available 
bandwidth. Therefore, information is often compressed before it is transmitted (or stored), to 
reduce the required bandwidth. For example, the HDTV standard was defined, at its inception, 
to include compression. Many types of signals are compressed, including still images, video 
and telephone conversations. The reigning compression standards are JPEG for still images 
and MPEG (I, II, HI or IV) for video. In actuality, these standards are standards for the 
compressed signals. There is no particular requirements, in the standard, on the method for 
converting the uncompressed signals into compressed signals. 

Compression and in some cases decompression are often very demanding and typically 
require dedicated hardware. Both JPEG and MPEG are transform-based methods, in which the 
uncompressed data is transformed into a transform space, where the data is represented by a 
set of coefficients. It is usually desirable that the coefficients have less autocorrelation than the 
image data or even no autocorrelation at all. Although the DCT transform does not completely 
decorrelate the coefficients, the correlation between them is significantly reduced. In other 
compression methods, other transform spaces are used. In transform space, some of the 
coefficients have a greater visual and/or other effect on the image, than other coefficients. To 
obtain compression, the coefficients are quantized, with fewer bits being allocated to those 
coefficients which have a lesser effect. Typically, a coefficient is quantized by dividing it by a 
weight and then rounding or truncating the result. 

Optical and electro-optical processors have been used in the art, to a small extent, for 
computationally demanding applications. However, with the advent of very fast electronic 
computer components and parallel processors, their acceptance has been limited. 

Performing some types of linear transforms, for example Fourier transforms, 
continuous cosine transforms and Walash transforms, using optical components is well known, 
for example, as described in "Cosinusoidal Transforms in White Light", by N. George and S. 
Wang, in Applied Optics. Vol. 23, No. 6, March 15, 1984, in "Hartley Transforms for Hybrid 
Pattern Matching", by Nomura, K. Itoh and Y. Ichioka, in Applied Optics, Vol. 29, No. 29, 
October, 10, 1990, in "Lens Design for a White-Light Cosine-Transform Achromat", by K. B. 
Fair and S. Wang, in Applied Optics, Vol. 34, No. 1, January 1, 1995 and in "Optical 
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Computing", by D. Feitelson, in a chapter titled "Optical Image and Signal Processing", pp. 
102-104 (which pages describe general discrete linear transforms using a lenslet array), and pp. 
117-129 (which describe matrix multiplication), MIT Press 1988, the disclosures of which are 
incorporated herein by reference. 
5 SUMMARY OF THE INVENTION 

An object of some preferred embodiments of the invention is efficient and/or fast 

; generation of compressed still and moving images, especially transform based compression 
methods. In a preferred embodiment of the invention, this object is achieved by using optical 
components which perform specific steps of a compression method. Some compression 

10 methods utilize models, e.g., of visual perception to provide lossy compression. In a preferred 
embodiment of the invention, the optical components used are selected to match physical 
processes and/or models which are mimicked by the compression method. Alternatively or 
additionally, the optical components are selected to perform computation-intensive steps, for 
example transforms, which can be performed effectively using optical components. 

15 A compression system in accordance with a preferred embodiment of the invention 

preferably comprises five stages, an input which receives the data to be compressed, an 
optional pre-processing stage which converts the representation of the data into a presentation 
more suitable for processing, a processing stage which performs the compression, an optional 
post processing stage which converts the representation of the compressed data into one 

20 suitable for output and an output stage which outputs the data. In a preferred embodiment of 
the invention, some or all of the stages are optical. In some embodiments, one or more 
electronic or hybrid electronic and optical stages may be used, for example for pre-processing 
the data. Additionally, in some embodiments, only some of the processing is performed 
optically, with the balance of the processing preferably being performed electronically. 

25 An aspect of some preferred embodiments of the invention relates to optical block 

transforms, especially of image data. In a preferred embodiment of the invention, an optical 
component is used to transform image data in blocks, with each block being transformed 
separately. In a preferred embodiment of the invention, the transform used is a DCT (Discrete 
Cosine Transform) transform, preferably a JPEG-DCT, which is the DCT transform variant 

30 used for JPEG. Alternatively or additionally, the transform is a wavelet transform, such as the 
S transform, S+P transform family, other integer to integer "wavelet-like" transforms, or 
general known wavelet transform (Daubechies etc.) useful for wavelet compression. 

Preferably, the block size is 8x8, which is a standard block size for many applications. 
Alternatively, different block sizes may be used, for example 16x16 or 64x64, possibly with 
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different block sizes and/or block aspect ratios for different parts of the image. For wavelet 
transforms, larger blocks are preferably used. 

An aspect of some preferred embodiments of the invention relates to performing a 
DCT (Discrete Cosine Transform) using optical processing, preferably a JPEG-DCT. In a 
5 preferred embodiment of the invention, a single optical element is used to transform data from 
an image domain to a DCT domain. A related aspect is an optical element which performs 
discrete wavelet and "integer to integer" wavelet transforms (such as the S and S+P 
transforms), for example using a combination of diffraction gratings neutral density filters (for 
weighting sums and differences). 
10 An aspect of some preferred embodiments of the invention relates to a block-DCT- 

transforming lens, preferably a JPEG-DCT performing lens. In a preferred embodiment of the 
invention, such a lens comprises a two dimensional matrix of groups of optical elements , each 
such group performing a DCT on a single block. Preferably, such a group comprises a lenslet 
array which performs the DCT directly. Alternatively, the matrix comprises a matrix of optical 
15 elements , with each optical element performing a DCT transform for a single block. 
Alternatively to performing a DCT transform, a correspondence between JPEG DCT and DFT 
(Discrete Fourier Transform) may be utilized, so that a Fourier-transforming lens (or optical 
element or lenslet array) is used. Preferably, optical or electrical components are provided to 
modify the data and/or the transformed data so that the Fourier lens generate a DCT transform, 
20 at least for real image data. Alternatively to block-DCT lens, a lens for performing other types 
of block transforms, such as a block- Wavelet-transform, can be provided. 

An aspect of some preferred embodiments of the invention relates to performing 
optical motion estimation. In a preferred embodiment of the invention, the motion estimation 
is performed on block-DCT-transformed data, by comparing DCT coefficients of neighboring 
25 blocks. Preferably the same hardware is used to perform DCT for motion estimation and for 
image compression. Alternatively or additionally to motion estimation, motion compensation 
may also be performed by correcting DCT coefficients of transformed data. 

An aspect of some preferred embodiments of the invention relates to data compression 
using optical components. In various preferred embodiments of the invention, individual steps 
30 of image compression methods are performed using optical components. In some preferred 
embodiments of the invention, multiple sequential steps are implemented using optical 
components, possibly without conversion back to electrical signals in-between steps. 

In a preferred embodiment of the invention, the data compressed is image data. 
Preferably, compression method is a transform based method, especially a DCT based method, 
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such as JPEG or MPEG. Alternatively or additionally, other type of data compression which 
require processing (not spatial zooming) may be used, for example, entropy encoding. In a 
preferred embodiment of the invention, at least the DCT and/or motion estimation steps used 
for the above compression methods are performed optically. Alternatively, the compression 
5 method is a wavelet based compression method. 

Alternatively or additionally to compression, data decompression may be effected 
using optical processing, for example to perform an inverse DCT. 

An aspect of some preferred embodiments of the invention relates to direct acquisition 
of images which are compressed, partially compressed or pre-processed for rapid compression. 

10 In a preferred embodiment of the invention, a camera uses a DCT-transforming lens, which 
receives light from an imaged object and projects a transform of the light onto an optical 
detector, such as a CCD, for data acquisition. Alternatively, other types of optical detectors, 
such as a CMOS detector may be used. Preferably, but not necessarily, other optical elements 
are provided between the DCT lens and the CCD to perform further optical processing and/or 

15 image compression on the data. Alternatively or additionally, optical and/or electro-optical 
elements are provided between the object and the DCT lens to perform pre-processing on the 
optical data, for example to change its data representation scheme, or to better process 
polychromatic light. In a preferred embodiment of the invention, the DCT lens accepts 
polychromatic light. Alternatively, color information is separated out of the light received 

20 from the imaged object and the DCT lens accepts monochromatic light. In a preferred 
embodiment of the invention, the optical processing is use to perform or aid in performing 
JPEG or MPEG compression. Alternatively or additionally, other compression protocols are 
performed. Alternatively to DCT lens, other block-transform lens may be provided, for 
example for an S-transform. 

25 An aspect of some preferred embodiments of the invention relates to using a 

continuous Fourier-transform optical system, for example a Fourier lens, for performing a 
discrete transform. In a preferred embodiment of the invention, data to the Fourier lens is 
matched to a data receptor at the other side of the Fourier lens to allow a discrete transform to 
be performed. 

30 An aspect of some preferred embodiments of the invention relates to deterrnining a 

matching between an SLM and a CCD to allow the use of Fourier optics for performing 
transforms, such as linear transforms. In a preferred embodiment of the invention, the size of 
elements in the CCD and the SLM is matched. Alternatively or additionally, one or more 
continuous spatially varying neutral density filter is used to match the CCD to the SLM. 



4 



WO 00/72267 PCT/IL99/00479 

An aspect of some preferred embodiments of the invention relates to using a discrete 
level SLM for performing transforms and/or other processing, rather than using a continuous 
level SLM. Preferably, a binary level SLM is used. In a preferred embodiment of the 
invention, data is encoded in bits, using a spatial and/or temporal encoding scheme using a 
5 binary SLM. Each such bit is then transformed individually and the result of the transform of 
; the original data is determined by weighted summing of the transformed bits. One advantage 
^ of binary SLMs is that they are often much faster than gray-level SLMs. Another possible 
advantage is that there are no phase differences between pixels, in some implementations. 
1 Another possible advantage is that a smaller dynamic range CCD can be used. Another 
10 possible advantage is that lower cost driving circuitry and/or SLMs may be sued, as linearity 
of the SLM is not generally an issue in binary SLMs. Another possible advantage is that 
absolute uniformity of intensity is not as strictly required in binary SLMs as in gray-level 
SLMs. Some of these advantages may also hold for continuous gray-level SLMs driven as 
Binary SLMs. This scheme may be used for linear transforms and especially for DCT and FFT 
j 15 transforms, as desirable in some preferred embodiments of the invention. It should be noted 
that bases other than two may be used, for example base three, in which a different tradeoff 
~J between SLM speed and system complexity may be achieved. Alternatively or additionally, 
' '~ 4 other numbers of discrete gray levels may be utilized in an SLM, for example to trade off 
z: speed and component complexity. Alternatively or additionally to breaking down data using 
22 20 number representation methods, other ways schemes of representing data as a combination of 
other data can be used, in one example the original data is separated in to a plurality of 
^ channels using a plurality of basis vectors (not 1, 2, 4... 256, which are the basis vectors for 
binary representation, described above), each channel being processed and then combined after 
the processing. 

25 An aspect of some preferred embodiments of the invention relates to reducing 

interactions between light from adjacent pixels or pixel groups. In a preferred embodiment of 
the invention, one or more of the following separation methods are practiced: frequency 
separation, spatial separation (preferably with a light absorbing or light redirecting separator 
between adjacent pixels), polarization axis differences, temporal offset and/or their 

30 combinations. 

An aspect of some preferred embodiments of the invention relates to using optical 
switching technology for transforming data or for otherwise processing data encoded using 
light waves. Preferably, calcite or other bi-refringent materials are used to split light beams, 
each original light beam representing a pixel or a part thereof. The split light beams are then 

5 
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added, subtracted and/or multiplied by constants to perform the required calculations (such as 
a DCT transform or a DWT transform), with the end result of the addition and subtraction 
being light waves encoding the transformed data. Alternatively to calcite, diffractive or 
refractive optical elements may be used to split the beams of light. 
5 There is thus provided in accordance with a preferred embodiment of the invention, a 

method of image compression, comprising: 
providing image-data encoding light; 

transforming said light from an image space to a transform space utilizing an optical 
component; and 

10 converting said transformed light into electrical signals, which electrical signals 

represent a compressed representation of said image data. Preferably, said converting 
comprises converting after quantization. 

There is also provided in accordance with a preferred embodiment of the invention, a 
method of image de-compression, comprising: 
15 providing compressed-image-data encoding light; 

transforming said light from a transform space to an image space utilizing an optical 
component; and 

converting said transformed light into electrical signals, which electrical signals 
represent said image data. 
20 In a preferred embodiment of the invention, said transforming comprises transforming 

using one or more optical elements which perform a block transform. Preferably, said one or 
more optical elements comprises a matrix of optical lens elements. Preferably, at least one of 
said optical lens elements comprises a lenslet array which performs a block transform for a 
single block. 

25 In a preferred embodiment of the invention, said one or more optical elements 

comprises an element which performs a vector by matrix multiplication. Alternatively or 
additionally, said one or more optical element comprises a refractive element, preferably, said 
refractive element comprises a bi-refringent material. Alternatively or additionally, said 
refractive element splits and combines beams representing individual data elements of said 

30 data. 

In a preferred embodiment of the invention, said one or more optical elements 
comprises an element which generates a matrix product. Preferably, said matrix product 
comprises a triple matrix product. 

In a preferred embodiment of the invention, said transforming utilizes at least one 
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electrical component for transferring data between said at least one optical component. 

In a preferred embodiment of the invention, said image is compressed using a JPEG 
standard. Alternatively or additionally, said image is compressed using an MPEG standard. 
Alternatively or additionally, said image is compressed using a wavelet compression method. 
5 Alternatively or additionally, said image data represents an image sequence. Alternatively or 
additionally, said providing comprises providing data encoded using discrete levels. 
Preferably, the data is provided as binary encoded data. Alternatively, the data is provided 
using a base three representation. 

There is also provided in accordance with a preferred embodiment of the invention, 
10 apparatus for direct acquisition of compressed image data, comprising: 

at least one optical element which receives light waves from an imaged object and 
which transforms said image into a transform space; and 

an optical detector which receives said transformed light and generates electronic 
signals responsive to said received light. Preferably, the apparatus comprises an optical 
1 1 5 quantizer which quantizes said transformed light prior to its reception by said detector. 

Alternatively, the apparatus comprises an electronic quantizer which quantizes said 
electronic signals to produce compressed data. 

In a preferred embodiment of the invention, said optical detector quantizes said light. 
In a preferred embodiment of the invention, said at least one optical element comprises 
20 a single optical element which performs said transforming. Alternatively or additionally, the 
apparatus comprises a storage unit for storing at least one set of said electronic signals, 
corresponding to a still image. Alternatively or additionally, the apparatus comprises a storage 
unit for storing at least one set of said electronic signals, corresponding to an image sequence. 
Alternatively or additionally, said transform space comprises a DCT transform space. 
25 Alternatively, said transform space comprises a wavelet transform space. 

In a preferred embodiment of the invention, said optical element comprises a planar 
two dimensional imager sandwiched to a planar two dimensional reflective spatial light 
modulator (SLM). Preferably, individual cells of said SLM are wired in parallel to individual 
cells of said planar imager. 
30 There is also provided in accordance with a preferred embodiment of the invention, a 

block-transform optical element, comprising: 

a plurality of optical groups each group comprising at least one optical sub-element, 
wherein each of said optical groups transforms a block of data. Preferably, said at least one 
sub-element comprises a lenslet array portion. Alternatively or additionally, said plurality of 
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optical groups are arranged as a matrix. Alternatively or additionally, said element performs a 
JPEG-DCT transform. Alternatively, said element performs an inverse DCT transform. 
Alternatively, said element performs a wavelet transform. 

In a preferred embodiment of the invention, said optical element performs said 
5 transform on data arranged as a spatially impulse image. Alternatively or additionally, said 
optical element performs said transform on data arranged as a continuous image. 

In a preferred embodiment of the invention, said transform comprises a linear 
transform. Alternatively or additionally, said transform comprises a non-separable transform. 

In a preferred embodiment of the invention, said optical groups overlap. Alternatively, 
10 said optical groups do not overlap. 

There is also provided in accordance with a preferred embodiment of the invention, a 
method of DCT-like transforming of data, comprising: 

providing optical waves which encode said data; and 

passing said waves through at least one optical element, which optical element 
15 modifies said optical waves into second optical waves carrying a transform of said data. 
Preferably, said transform comprises a block transform. Alternatively or additionally, said at 
least one optical element is an atomic optical element. Alternatively, said at least one optical 
element comprises a plurality of optical elements. 

In a preferred embodiment of the invention, said at least one optical element comprises 
20 a discrete optical processing element. Alternatively, said at least one optical element comprises 
substantially only continuous optical processing element. 

In a preferred embodiment of the invention, said transform is a JPEG-DCT transform. 
Alternatively, said transform is an inverse DCT transform. 

There is also provided in accordance with a preferred embodiment of the invention, a 
25 method of optical motion estimation, comprising: 

providing a first set of light waves encoding data of a first image block; 

DCT transforming said first set of light waves using an optical component; 

providing a second set of light waves encoding data of a second image block; 

DCT transforming said second set of light waves using an optical component; and 
30 processing said first and said second DCT transformed data sets to determine an 

amount of relative motion of said two blocks. Preferably, both of said DCT transforms utilize a 
same optical component for said transforming. Alternatively or additionally, said processing 
comprises electronically processing said transformed data sets. Alternatively or additionally, 
the method comprises utilizing said determined motion for generating a compressed image 
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stream. 

There is also provided in accordance with a preferred embodiment of the invention, a 
method of transforming data using a discrete transform, comprising: 

preprocessing said data to yield optically encoded data; 
5 Fourier transforming said data using a Fourier lens; and 

postprocessing said data to yield transformed data. Preferably, said preprocessing 
comprises optically preprocessing. Preferably, said preprocessing comprises matching said 
data to said postprocessing. Preferably, said postprocessing comprises acquiring said data and 
wherein said matching comprises matching to said acquisition. Preferably, said postprocessing 
1 0 comprises spatially modulating said light. 

In a preferred embodiment of the invention, said preprocessing comprises spatially 
modulating said light. 

In a preferred embodiment of the invention, said spatially modulating comprises 
masking said data using an array of pinholes. Alternatively, said spatially modulating 
1 5 comprises continuously varying said amplitude of said data. 

In a preferred embodiment of the invention, said preprocessing comprises mirroring 
said data. Alternatively or additionally, said transform comprises a JPEG-DCT transform. 
Alternatively, said transform comprises a wavelet transform. 

In a preferred embodiment of the invention, said transform comprises an inverse DCT 
20 transform. 

There is also provided in accordance with a preferred embodiment of the invention, 
apparatus for compressed image data manipulation, comprising: 
an input for receiving data; 

at least one optical component for transforming said data between an image space and a 
25 transform space; and 

an output for outputting said manipulated data. Preferably, said received data 
comprises uncompressed image data and the apparatus comprises a processor for processing 
said data after said transform to yield compressed image data to be outputted. 

In a preferred embodiment of the invention, said received data comprises compressed 
30 image data and the apparatus comprises a processor for processing said data before said 
transform to yield transform data to be transformed by said optical component for said output. 
Preferably, said processor includes an optical D/A converter. Alternatively or additionally, said 
processor comprises an optical multiplier for de-quantizing data. Alternatively or additionally, 
said processor performs at least some of its processing on optic waves. 
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In a preferred embodiment of the invention, said processor performs at least some of its 
processing on electronic signals. Alternatively or additionally, the apparatus comprises an 
optical motion estimator. Preferably, said optical motion estimator utilizes said optical 
component for optical motion estimation. Alternatively or additionally, said optical motion 

5 estimator includes at least one electronic component. 

In a preferred embodiment of the invention, the apparatus comprises an optical motion 
compensator. Preferably, said optical motion compensator utilizes said optical component for 
optical motion compensation. Alternatively or additionally, said optical motion compensator 
includes at least one electronic component. 

10 In a preferred embodiment of the invention, said data is compressed using a JPEG 

compression. Alternatively, said data is compressed using a wavelet compression. 
Alternatively, said data is compressed using an MPEG compression. 

In a preferred embodiment of the invention, said data comprises an image sequence. 
Alternatively, said data is a single image. 

15 In a preferred embodiment of the invention, said data is manipulated as blocks. 

Preferably, at least two of said blocks are manipulated in parallel. Alternatively or 
additionally, at least two of said blocks are manipulated in series and the apparatus comprises 
a buffer circuit for directing said blocks in series into a single optical component. 

In a preferred embodiment of the invention, said optical component comprises a 

20 discrete data transforming optical element. Alternatively or additionally, said optical 
component comprises a holographic lens. Alternatively or additionally, said optical component 
comprises an acousto-optic element. Alternatively or additionally, said optical component 
comprises an optical analog to digital converter. Alternatively or additionally, said optical 
component comprises an optical digital to analog converter. Alternatively or additionally, said 

25 optical component comprises a matrix product calculating element. Alternatively or 
additionally, said input comprises a binary SLM (spatial light modulator). Alternatively or 
additionally, said input is matched to said output to account for non-point light sources and 
detectors. Alternatively or additionally, said apparatus processes a plurality of data blocks in 
parallel. Preferably, different data blocks are encoded differently, to reduce cross-talk between 

30 them. Preferably, said different encodings comprises different polarizations. Alternatively or 
additionally, said different encodings comprises different light frequencies. 

In a preferred embodiment of the invention, the apparatus comprises light attenuators 
arranged to attenuate light leaking between areas processing different data blocks. Preferably, 
said attenuators comprises solid attenuators Alternatively, said attenuators comprises a 
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plurality of attenuator portions spaced apart along a main propagation axis of light, such that 
leakage light impinges on said at least one of said attenuator portions at a substantially 
perpendicular angle. 

In a preferred embodiment of the invention, said attenuators are formed of at least one 
5 stack of transparent optical material having a plurality of light absorbing areas defined thereon, 
which light absorbing areas do not extend vertically in a continuous manner through said 
stack. 

In a preferred embodiment of the invention, said optical component comprises a bi- 
^ refxingent material. Preferably, said material comprises calcite. 

10 In a preferred embodiment of the invention, said optical component splits and 

combines light beams representing separate data elements. 

There is also provided in accordance with a preferred embodiment of the invention, a 
method of data processing, comprising: 

spatially encoding light to carry said data using a discrete-level SLM (spatial light 
'> l; 15 modulator); 

applying a linear transform to said data using one or more optical components to 
manipulate said light; and 

detecting said manipulated light using a spatial light detector. Preferably, said SLM is 
driven as a binary SLM. Alternatively said SLM is driven as a three gray-level SLM. 
: 20 In a preferred embodiment of the invention, spatially encoding said data comprises 

splitting said data into separate planes, each representing one ordinal position of said digital 
representation and comprising combining said manipulated light. Preferably, said light is 
combined optically. Alternatively, said light is combined electronically, after detection. 

In a preferred embodiment of the invention, said transform comprises a DCT 
25 transform. Alternatively, said transform comprises a Fourier transform. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The present invention will be more clearly understood from the following detailed 
description of the preferred embodiments of the invention and from the attached drawings, in 
which: 

30 Fig. 1 is a flowchart of a baseline method of JPEG-compliant compression; 

Fig. 2 is a schematic block diagram of an optical JPEG compression system, in 
accordance with a preferred embodiment of the invention; 

Fig. 3A is a schematic block diagram of a matrix-multiplication based optical DCT 
component, in accordance with a preferred embodiment of the invention; 
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Fig. 3B is a schematic block diagram of an optical matrix by vector multiplication 
component, in accordance with a preferred embodiment of the invention; 

Fig. 4A is a schematic diagram of a lens-matrix based 2D DCT component, in 
accordance with a preferred embodiment of the invention; 

Fig. 4B is a schematic diagram of an optical element for the lens matrix of Fig. 4 A; 

Fig. 4C is a schematic diagram of a lenslet array for the lens matrix of Fig. 4A; 

Fig. 4D is a schematic illustration of an optical system for performing a DCT transform 
using a Fourier lens; 

Fig. 5A is a schematic block diagram of an optical JPEG compression system, in 
accordance with another preferred embodiment of the invention; 

Fig. 5B is a schematic cross-section of a channel separation method in accordance with 
a preferred embodiment of the invention; 

Fig. 6 is a schematic flowchart of a base-line method of MPEG-compliant 
compression; 

Fig. 7A is a schematic diagram of a direct-compression camera system, in accordance 
with a preferred embodiment of the invention; 

Fig. 7B is a schematic block diagram of a YUV-separated implementation of the 
embodiment of Fig. 7 A; 

Fig. 8 is a schematic diagram of a lithographic implementation of an optical 
compression system in accordance with a preferred embodiment of the invention; 

Fig. 9A is a flowchart for a DIF (decimation in time) type of DCT computation; 

Fig. 9B is a schematic figure of a calcite based DCT transforming optical element, in 
accordance with a preferred embodiment of the invention; and 

Fig. 10 is a schematic figure of a detail of Fig. 9B. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

Fig. 1 is a flowchart of a base-line method 20 of JPEG-compliant compression. Image 
data is first transformed using the DCT (Discrete Cosine Transform) (22), to generate a set of 
coefficients. These coefficients are then quantized (24). The quantized coefficients are then 
unfolded from a 8x8 representation to a 64x1 representation ("Zig-Zag", 26). These quantized 
coefficients are encoded using a variable-length encoding scheme (28), zero-run length 
encoded and then Huffman encoded (30), to reduce entropy. A compressed data file is then 
generated by prefixing the encoded data with header information (32). Other, similar, methods 
of JPEG compression are also known. 

In accordance with a preferred embodiment of the invention, various of the above steps 
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performed using optical elements, rather than using electronic or software elements. In the 
above described JPEG compression method, the step that is typically most computationally 
demanding, is the DCT step. Thus, in a preferred embodiment of the invention, the DCT step 
is performed optically. 

Fig. 2 is a schematic block diagram of an optical JPEG compression system 50, in 
accordance with a preferred embodiment of the invention. An electronic input 52 is preferably 
used to receive the data to be compressed. This element will generally depend on the 
application for which system 50 is used. For example, if system 50 is implemented on a PC 
card, electronic input 52 will generally comprises a PC-compatible bus connector. The 
acquired data is then converted into light, using a spatial light source 54. In a preferred 
embodiment of the invention, light source 54 comprises an SLM (Spatial Light Modulator) 
which modulates a beam of light that is reflected from it or that is transmitted through it. 
Alternatively, source 54 may comprise an array of LEDs, laser diodes, VCELs (vertical cavity 
emission lasers) or other types of pixelated display devices such as CRT, field effect emitter 
arrays and plasma displays. 

The type of light emitted by source 54 is preferably selected to match an optical DCT 
unit 56. In some preferred embodiments of the invention, the light from source 54 is coherent 
(so a laser source is preferably used). In other embodiments, the optics do not require coherent 
light. In a preferred embodiment of the invention, the light is preferably monochromatic. 
Alternatively, polychromatic light may be used. In some particular preferred embodiments of 
the invention, multiple frequencies of monochromatic light are used, for example wherein the 
frequencies are used to encode attributes of the data, such as its numerical sign. In a preferred 
embodiment of the invention, the data is encoded using an analog encoding scheme, for 
example phase or amplitude. Alternatively, a digital encoding scheme is used. Possibly, as 
described below, the light may be A/D converted from analog-encoding light into digital- 
encoding light, for example after it is transformed. 

Optical DCT unit 56 transforms the light from an image space to a transform space. 
Preferably, the transformed light is projected unto a spatial optical sensor 58, such as a CCD 
array. Details of various types of DCT unit 56 and methods of construction thereof are 
provided below. 

Data is read out of CCD array 58 and then it is quantized, using a quantizer 60. In a 
preferred embodiment of the invention, the quantization may be performed by setting gain 
and/or offset characteristic of the CCD and/or individual elements thereof and/or controlling 
the readout of the CCD, for example to provide a reduced bit-per-pixel ratio. Alternatively, the 
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data is quantized as it is read off the CCD or after it is read off the CCD. Alternatively or 
additionally, the data is quantized by optical means, such as a second SLM in front of the 
CCD. The unfolding of the data may be performed before the quantizing or after the 
quantizing. Then, the data is encoded using a variable length encoding unit 62, Huffman- 
5 encoded using a Huffman encoding unit 64 and, finally, a header is attached to the compressed 
data so that it meets the JPEG standard. Alternatively or additionally, the data is encoded using 
arithmetic coding (preferably performed by an arithmetic coding unit - not shown). 

As will be described below, additional elements of the compression system may be 
replaced with optical units. In some embodiments of the invention, the different optical units 
10 will be interconnected with electrical circuitry, for example for control, data management or 
data conversion. Thus, even if two consecutive units are embodied using optical means, they 
may have an intervening step of optical/electrical conversion and then electrical/optical 
conversion. In other embodiments, the processed light will feed directly from one optical unit 
to the next. In a preferred embodiment of the invention, a system includes both optical and 
15 electronic components and the processing is divided between the components so they can act 
in parallel. In one example, some of the transforming may be performed optically and some 
electronically. Such dividing up of work, can better utilize all the elements in a 
compression/decompression device, especially if some of the components are dual use, for 
example DSP components. 
20 Optical DCT unit 56 may be implemented in various ways. It should be noted that 

when compressing images, the DCT transform applied is in actuality a block-DCT transform, 
where each part of the image is separately transformed. 

Fig. 3A is a schematic block diagram of a matrix-multiplication based optical DCT 
component 70, in accordance with a preferred embodiment of the invention. The DCT 
25 transform can be presented in matrix form as [DCT]=[C][T][C]. Matrix by matrix 
multiplication may be performed in many ways, including using multiple repetitions of vector 
by matrix multiplication, for example as described in "Introduction to Fourier Optics", 
Goodman, pp. 286, or using direct matrix by matrix multiplication, for example as described in 
Feitelson, pp. 126-127 (double or triple products), preferably using monochromatic coherent 
30 light, or as described in Feitelson, pp. 118, using lenslet arrays, which can accommodate white 
light; the disclosure of all of which is incorporated herein by reference, 

In a vector by matrix embodiment of component 70, a line data provider 72 provides 
individual lines or columns of an 8x8 block to a matrix multiplier 74. The DCT transform of a 
vector can be performed by multiplying a source vector V by a convolution matrix C, to obtain 
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a transformed vector T. For each 8x8 block the lines (or the columns) are individually 
transformed and then the result is transformed along the individual columns (or lines). In a 
preferred embodiment of the invention, the data is row transformed using a first unit 74 and is 
then column transformed using a second multiplication unit 74'. Alternatively, a same unit is 
used for both the row and column transforms. Preferably, the transformed row data is 
accumulated using a store unit 76. If each one of the rows is transformed in sequence, the 
transformed row data may be accumulated using store 76 even if a separate unit 74' is used for 
column transforms. 

Fig. 3B is a schematic block diagram of an optical matrix-by-vector multiplication 
component 80, in accordance with a preferred embodiment of the invention. When performing 
a DCT transform, negative-valued results may be produced. Multiplication component 80 
separately processes negative- and positive- valued results, to avoid miss-processing. 
Mathematically, the multiplication of a matrix C by a vector V is a linear operation, so that it 
can be separated in to negative and positive components, e.g.: C*V=Cp*Vp+Cn*Vn-Cp*Vn- 
Cn*Vp, where the "n" subscript indicates negative numbers and the "p" subscript indicates 
positive numbers. In the component of Fig. 3B, vector V is separated into positive and 
negative values, which are each separately multiplied by positive or negative valued 
component matrixes 82 and then summed using subtracters 84 and an adder 86. In a preferred 
embodiment of the invention, four matrix multiplication units 82 are provided. Alternatively, 
only two or even only one unit 82 is used, for example to sequentially process negative and 
positive numbers. In general, the source data is all positive, so that the vector Vn is empty. It is 
noted that the DCT of the original image data, which is positive, may be simpler to implement 
than the DCT of transformed data, which may be negative. 

In a preferred embodiment of the invention, sign issues are solved using a bipolar 
number representation. In a bipolar representation, each number is designated by two 
components: s=[p,n], where s is a general signed number (not necessarily an integer), and [p,n] 
are its positive and negative components, s is retrieved by setting s=p-n. Therefore, the number 
-5 can be described by [0,5], [3,8], [10,15], [1,6] or other combinations of p and n, as long as 
p, n > 0, and p-n=s. 

The generalized bipolar representation can be adapted to matrix calculation, by 
representing each number by a 2x2 matrix, of the form 
[pn] 
[np]. 

For example: 
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This representation can be extended to triple product matrix multiplication. 

The [p,n] representation may be implemented using separate optical beams to represent 
each of the p and n components. Alternatively, a single, multi-characteristic beam may be used 
to represent both components. In one example, different optical frequencies are used for the 
different components. Alternatively or additionally, different polarizations are used for the 
different components. The two components may be separated out after processing, for example 
one component being diverted (or copied) to a different CCD. Alternatively, a single optical 
detector detects both components, for example a detector that is sensitive to the difference 
between the amplitudes in the two frequencies. Such a detector may be implemented by 
electronically subtracting the output of two adjacent detectors, each detector being sensitive to 
a different frequency. 

Alternatively to the method of Fig. 3B, negative numbers may be dealt with in other 
ways. In one example, negative and positive numbers are differentiated by their phase. A 
diffraction grating can be used to divert numbers with one phase value to a different part of a 
CCD target (or other optical element) than those numbers with a second phase values. In 
another example, negative numbers are encoded using a different frequency than positive 
numbers. The different frequencies can be separated using suitable gratings or other optical 
elements. Alternatively or additionally, a self-electro-optical device may use one frequency in 
order to modulate the other frequency. Alternatively or additionally, a frequency sensitive 
CCD may be used, for example an RGB CCD. Alternatively or additionally, a CCD may be 
provided with binary phase or frequency detection, by providing a controllable polarizer or 
spectral filter before the CCD and timing its operation to the acquisition of positive or negative 
numbers. 

Alternatively, negative numbers may be managed by biasing them to be positive, for 
example, by forcing the results of a DCT to be in the range [0...2] instead of 
(normalized values). In practice, if the maximum DC amplitude is A, the DCT results are 
shifted by +A, from the range [-A. . .A] to the range [0...2A]. In the example (described below) 
where a DCT is performed by mirroring the 8x8 datablock into a 16x16 datablock, a strong 
spatial delta pulse is provided in the middle of each 16x16 datablock, for example by 
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controlling the SLM. The effects of this pulse (the bias) are preferably removed using 
electronic processing after the data is transformed. 

Once the data is multiplied, further processing, such as sign extraction or as described 
below, can be achieved, for example, by performing optical A/D, and then binary operations or 
by using electronic components. 

In the above description, a plurality of matrix-by-matrix or vector-by matrix operations 
are performed. The number of actually provided multiplication units depends on the 
implementation and especially on the level of parallelism of the implementation. For example, 
in one implementation, all the 8x8 blocks are processed in parallel. However, within each 
block, the multiplications may be performed in parallel (using a plurality of units if required) 
or in sequence (reusing a single unit for two operations, for example for row and for column 
DCT). Alternatively or additionally, two or more of the blocks may be processed in series, for 
example the two blocks sharing a single 8x8 multiplier. Such sequential processing generally 
requires electronic components, such as store 74, to read and store intermediate results and 
possibly also for summing up the individual results. 

In a preferred embodiment of the invention, each matrix multiplication unit comprises 
a series of {SLM, lens, CCD} sub-systems which unit accepts electronic data at one end, 
converts it into optical signals, transforms the data using lens and then converts the 
transformed data into electronic signals again. Alternatively, a single SLM and/or a single 
CCD may be shared among several multipliers. 

Fig. 4A is a schematic diagram of a lens-matrix based 2D DCT component 90, in 
accordance with a preferred embodiment of the invention. Light from an image of an object 92 
impinges on a lens-matrix 94. Array 94 preferably comprises a plurality of lens-elements 95, 
each of which performs a DCT on one 8x8 block of image 92. The result of the DCT is 
recorded by a CCD 96. 

Fig. 4B is a schematic diagram of a single optical element 98 suitable for the lens 
matrix of Fig. 4A, for performing a DCT. Optical element 95 is designed so that light emitted 
by different portions of the lens corresponds to different coefficients of the DCT transform of 
the impinging light. Thus, light corresponding to a first DCT coefficient is detected by CCD 
96 at a point A. Light corresponding to a second DCT coefficient is detected at a point B. 
Typically, at least some of the light emitted by lens 95 does not correspond to a DCT 
coefficient, due to design considerations. Such light may be detected, for instance at a point C. 
The readout of CCD 96 is preferably configured to account for the correspondence between 
DCT coefficients and spatial locations on CCD 96. In a preferred embodiment of the 
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invention, a plurality of or even all of optical elements 98 are combined into a single 
composite optical element. Alternatively, a single optical element 98 may be implemented as a 
sequence of individual optical elements. 

Fig. 4C is a schematic diagram of a lenslet array 100 for the lens matrix of Fig. 4 A, for 
performing a DCT. In a lenslet array, each individual lenslet preferably generates one DCT 
coefficient from the impinging light. In one exemplary embodiment, light from a 8x8 block of 
the image is received by 64 lenslets, preferably arranged in a 8x8 array. After each lenslet is a 
mask having opaque and transmissive portions and a CCD element is positioned opposite the 
mask to receive light which passes through the mask. In an exemplary embodiment, each 
lenslet creates an image of the image to be transformed. Each DCT coefficient d(k,l) is defined 
as: 

NN /-u 
l i 

where f is the input and h is the convolution definition. The opaque and transmissive portions 
of each of the (k,l) masks are defined to represent the values of h, in which the 
transmissiveness of mask elements for a lenslet (k,l) are denned to match the relative 
contribution of those image pixels (i,j) which take part in determining the (k,l) coefficient. The 
CCD element sums the light which passes through the mask, determining the DCT coefficient. 

The Formula for a DCT transform and for an inverse DCT transform of an 8x8 block of 
image data f(x,y) and an 8x8 block of transform data F(u,v), are, respectively: 
1 7 7 (2x+\)ux (2y +l)vx 

f(u,v)=-c(u)c(v)Y X /(^cos- 5 -— — cos — ii — 

x =Qy=0 



: 00 = tI S C(u)C(v)F(u,v)cos K } cos 



4 

* u =0v=0 

where C(u) and C(v) are \N2 for u,v=0 and 1 otherwise. 

In a preferred embodiment of the invention, a single large lenslet array is used to 
implement a matrix of individual lenslet arrays. In a preferred embodiment of the invention, 
the light from object 92 is focused onto lens matrix 94, so that all of the object is viewed by 
each one of the lens elements 95. Alternatively, only a block area of the light impinges on each 
lens element, for example by providing multiple side-by-side lens, each one viewing only a 
portion of object 92. Alternatively, where an SLM is used, the light which passes through the 
SLM can be formed of blocks of non-parallel light, so that block portions of the modulated 
light impinge each on a different lens element 95. Alternatively, especially where individual 
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optical elements are used, the light from object 92 can be parallel light, so that each optical 
element receives parallel light from a single block area. In some cases, a lens element may 
receive light from more than one block area, for example for processing which is beyond the 
extent of a single block or to provide an overlap between blocks, for example to solve 
5 calibration problems. 

Fig. 4D is a schematic illustration of an optical system for performing a DCT transform 
using a Fourier lens. Although in one preferred embodiment of the invention the lens- element 
directly performs a DCT, in an alternative preferred embodiment of the invention, a 
correspondence between Fourier transform and DCT is utilized to perform DCT (or other 

10 transforms) using a Fourier transform lens. Mathematically, a Fourier transform of real and 
symmetrical data results in only real (and symmetric) cosine coefficients. The image data to be 
compressed is typically real. It can be made symmetric by mirroring in the SLM. In order to 
achieve a discrete transform, the data is preferably provided as an impulse image, with each 
image portion being a spatial delta function , each of which pulses is transformed using a 

15 Fourier transform lens. This type of data provision can be achieved using an SLM with a 
pinhole filter. In multi-wavelength based embodiments, different pinholes may be designated 
for different wavelengths. Preferably both the SLM and the CCD are spatially matched 
according to the following formula: Ax = 0.5Ax 3 which defines the distances between the delta 

Au = 

functions (pinholes) in the SLM and 2 ■ Ax • N ? which defines the distances between the 
20 delta-function receptor in the CCD (can also be modeled by providing a pinhole filter in front 
of the CCD. In these formula, Ax and Au are the intervals between delta functions in the SLM 
and CCD respectively, f is the focal length, N is the block size and Axis the placement of the 
delta function in the interval (phase shift) in the SLM. It can be seen that the pixels intervals in 
the CCD and the SLM are not necessarily the same, which may be implemented by ignoring 
25 some of the CCD pixels. An alternative matching condition is described below. 

In the example of Fig. 4D, an 8x8 block of image 92 is made symmetric using a 
doubling and mirroring optical system 93 (alternatively to using an SLM) and then 
transformed by a Fourier lens 97. Since the data is mirrored in two dimensions (only one 
shown for clarity) a 8x8 block is transformed into a 16x16 block. The result is then combined 
30 using a combining optical system 99, to provide an 8x8 DCT transform. In some embodiments 
of the invention, optical system 93, lens 97 and optical system 99 are combined into a single 
optical element, thus, the end result is a single optical element which performs a DCT, suitable 
for use in lens-matrix 94. A matrix of such optical elements may be combined to form a single 
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optical element which performs a block DCT transform. Alternatively to the optical systems 
shown, other constructions can be utilized for mirroring, doubling and combining. In one 
example, an image block is first doubled and arranged as a 2x2 matrix of blocks and then 
individual blocks of the 2x2 matrix are flipped, to provide the symmetry required for the DCT 
- transform (or other type of transform). 

The correspondence between Fourier transform and DCT can also be utilized for other 
optical transform architectures, for example the matrix-vector multiplication method described 
above. In another example, a wavelet transform can be performed by mirroring data to be anti- 
symmetric instead of symmetric, as in the DCT case. 

The above matching condition may be derived using the following analysis (for a one 
dimensional case). The following equation defines the JPEG-DCT which is to be achieved: 

TO-^Z'Wo**^) (2) 

n=0 Z/V 

Assuming symmetric input, where every block of 16 samples is represented as a 
combination of delta functions, spaced at intervals of size Ax, and transmitted from a 
Ax position inside each interval: 

N-l=7 N-l=7 
*(■*) = 2 /(")•<?(* -"-Ax -Ax) + £/00-^(* + «-Ax + Ax) 

«=0 „=0 (3) 

Applying the optical Fourier transform: 
co j 2mix 

s(u)= js(x)-e % dx 

(4) 

The imaginary parts cancel out (due to the input being symmetric): 
N-l-l 

s(u)= X /(")-cos( K —- i) (5) 

n=0 ** 

Assuming accurate sampling at the Fourier plane (the CCD): 
N-\=l 

s ( k )= 2. /(")-cos( y - J -) 

n=0 ^ (6) 

Since equation (2) is desired, we match: 
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* (*) = 2. /(«) • cos( — -) = 



n=0 

#-1=7 



Z /(«)-cos( ^ ) (?) 



n=0 



Thus, one matching condition is: 



27i-k-Au-(n«Ax + Ax) x ,7dc(2n + tt 
cos( _ } = cos(-^— ) 



(8) 



Leading to: 

Au- Ax 1 

kf = 2N (9) 



2-Au-Ax 1 



(10) 



Xf 2N 
resulting in the above matching condition: 
Ax = 05 • Ax 

Au = 

2Ax-N 

In some cases, it may be not be suitable to provide delta functions (pinholes or other 
optical elements) on one or both of the SLM and CCD. The following analysis shows a 
method of matching a CCD and an SLM, by spatially modulating the light in a less drastic 
manner, for example using continuous neutral density filters. 

The following equation describes an SLM-like object: 

N-l=7 N-\=l 
s(x)= £/(«)•/(*-«. Ax) + X/(»W<* + »-Ax) 

n=0 n=0 ( 12 ) 

Where l(x) is a general transmission function of the SLM, assumed identical for all 
pixels, and symmetric, so it can be mirrored. However, it should be noted that a similar but 
more complex analysis can also be performed in the case where not all the pixels are identical. 

After applying the optical (and continuous) Fourier transform: 

n=0 * (13) 
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Where L(u) is the Fourier transform of l(x). Since the actual sampling is done by summing all 
intensities on a detector cell (i.e., a CCD pixel cell), equation (5) transforms to: 
j k-Au+Au/2 
J(k) = ^ \s(u)W{u)-du 

k-Au-Au/2 (14) 

Where W(u) is the CCD detection weight function. Again, it is assumed that W is the same for 
all pixels but this assumption is not required. Using equation (13): 

^ k-Au+Au/2 (N-l=7 

* (k) = te 1 W(u) '\ £ /(»)•£(*)• cos(- 
k-Au-Au/2 { k=0 

Since equation (2) is desired, we match: 



(15) 



ix , k-Au+Au/2 
— ~ x f W(u) ■ L(u) • cos( f iaX ) ■ du 



k-Au-Auj2 
We define: 

R(u) = W(u)-L(u)/Au 
The matching requirement is thus: 
k-Au+Au/2 



(16) 



(17) 



^2« + n 



J 



„ 2?r-n- Ax 

R(u)-cos( )du , n,k = 0,l,...N-l 

^9 



(18) 



k-Au-Au/2 

Which results in the following NxN Fredholm I equations (for the ID case. In 2D its 
NxNxNxN equations): 
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> = 0,n = 0: 

Ai7/2 
1= \R(u)du 

Am/2 
k = 0,n = k 
Au/2 
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1= J R(u)cos( ^JL )du 



Au/2 



Au+Au/2 



C ° S( 2N )= l R(u)du 



Am -Au/2 
l,n = l: 

3 ^ Au+Au/2 

cos ^)= j *(M)cos( 2 ^'% fo 
Am-Aw/2 



(19) 



Equation set (19) defines a Fourier coefficients solution to the problem of describing 
R(u) by cosine series, i.e., 



N-l=7 

Z,zk(2n + l)^ 2x-u-n-Ax 



(20) 



This solution preferably defines a matching between individual pixels in the SLM (u) 
and the CCD (k). u e[k • Au - Au/2 , k • Au + Au/2] . 

It should be noted that equation 20 actually defines a family of solutions, thus, in some 
embodiments of the invention, standard geometries of SLMs and CCDs are used, while in 
others one or both of the SLM and CCD are modified to better fit a particular matching 
solution. In the general case, the matching may be performed by using neutral filters and by 
matching at least the locations, if not the sizes of CCD and SLM pixels. 

In a preferred embodiment of the invention, the above matching condition(s) are 
applied towards other discrete linear transforms which are to be applied using Fourier lens: 
N-l 

Hk)= £/(«)• C(*,») 

n=0 (21) 

Applying the same procedure, as in equations (12)-(20), (18) now reads: 
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k-Au+Au/2 
C(k,n)= J i?(w)-cos(- 
k-Au-Au/2 



,2k-h-Ax^ 



-)-du , n,k = 0,l,...N-l 



(22) 



So for the general ID linear transform: 



N-l 

£ C(k,n)-cos(- 
n=Q 



If ' 



: ), x\ k e[kAu-Au/2,kAu + Au/2] 



(23) 



or the matching condition of equation (11) can be used. In the context of matching conditions 
it should be noted that a matrix arrangement of sub-elements is not required. Rather, it is 
sufficient that there be a correspondence between the pixels in the SLM and the pixels in the 
CCD. A simple construction is that of a matrix of elements. 

The use of the above matching condition may depend on the type of detector used. A 
standard CCD detector measures power (amplitude squared). Thus, a square root of the 
measurement may need to be determined. Additionally, some types of processing require the 
sign of the result, or even its phase. Various methods of detennining a sign of the result are 
described above. A related issue is that a CCD detector integrates the square of the amplitude, 
so when even after taking a square root the result is not precise. However, in many cases the 
effect of the error is negligible and usually smaller than that allowed by the JPEG standard. 
This error is especially small if most of the CCD area (for each pixel) is ignored. Ignoring 
most of the CCD area is also useful in that it reduces noise, albeit usually requiring more 
signal strength. 

Alternatively, an amplitude (rather than power) detector is used, for example using a 
detector with a gamma of 0.5. Alternatively or additionally, a phase detector is used to 
determine the sign. One possible implementation of a phase detector is to supply a polarized 
reference beam that can be compared to the detected beam, for example using inference 
effects. 

In an alternative preferred embodiment of the invention, DCT, FFT or block transforms 
are achieved using a holographic lens, for example replacing lens-matrix 94, individual lens- 
elements 95 and/or other optical elements (described below). Alternatively or additionally, two 
dimensional holograms may be used, for example, by providing arrays of phase and amplitude 
modifying materials, instead of refracting elements. Alternatively or additionally, a look-up- 
table based approach to transforming may be used, for example using the look-up table 
methods described in US Patent No. 4,892,370, the disclosure of which is incorporated herein 
by reference. Alternatively or additionally, acousto-optical type optical elements are used. An 
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advantage of transform-lens, such as described with reference to Figs. 4A-4D, is that they are 
better matched to the physical model of the compression, i.e., transforming data from an image 
space into a transform space. Holograms are a general purpose optical element design method, 
which although they are very flexible, may have an efficiency penalty. Look-up tables are 
general purpose solutions which may require a larger and/or more complex optical architecture 
than a matched architecture such as a lenslet array. 

Fig. 5 A is a schematic block diagram of an optical JPEG compression system 110, in 
accordance with another preferred embodiment of the invention, in which the DCT 
transformed data is further processed prior to being converted to electrical signals. A main 
difference from the embodiment of Fig. 2 is the provision of an A/D converter 112, which 
converts the data from an analog representation to a digital representation. Thus, coding (e.g., 
VLC and Huffman) can be performed optically using various types of available hardware 
architectures. The Zig-Zag step (26) may be performed before or after quantization, for 
example, even after the data is converted to electrical signals, by optical sensor 58. An 
exemplary optical A/D converter is described in "Real-Time Parallel Optical Analog-to-Digital 
Conversion", by A. Armand, A.A. Sawchuk, T.C. Strand, D. Boswell and B.H. Soffer, in 
Optics Letters, Vol. 5 No. 3, March 1980, the disclosure of which is incorporated herein by 
reference. 

In the embodiment of Fig. 5A, quantization is shown as being performed on the optical 
data, for example utilizing an SLM or a controllable attenuator such as an LCA with one or 
more face polarizers which selectively "divide" DCT coefficients by a weight. Alternatively, 
the data is quantized after the A/D conversion, for example using a suitable lookup table or a 
holographic lens. In embodiments where digital data is represented by spatial bit patterns, as in 
the above paper ("real-time"), quantizing may be performed by spatially blocking out certain 
bits. In embodiments where digital data is represented temporally, temporal filtering may be 
used in which certain pixels are darkened, in synchrony to the bit order of the light pattern, so 
that those bits are blocked out. It is noted that the quantization step and the encoding step (at 
least the VLC) may be combined as a single step, using relatively standard tables, as known in 
the art of electronic JPEG. 

In some embodiments of the invention, it is desirable to achieve different spatial and/or 
bit resolutions for different parts of the image. In one example, the CCD can be read out at 
varying resolutions, responsive to the desired spatial resolution. In another example the light 
source is defocused for portions where a lower resolution is required. Alternatively or 
additionally, the quantization is varied between the blocks. If for example quantization is 
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achieved by selective blocking of pixels, this blocking may be implemented using an 
electrically controllable spatial filter, for example an LCD, which can be set to the desired 
quantization. 

In a preferred embodiment of the invention it is desirable to simultaneously generate 
multiple resolutions of JPEG data. In a preferred embodiment of the invention, this is achieved 
by parallel application of the JPEG algorithm, using hardware as described herein. 
Alternatively, this may be achieved (for example in the embodiment of Fig. 2) by reading out 
the CCD at different resolutions, for different JPEG resolution levels. Alternatively, varying 
resolutions may be achieved by zooming the source image 92 up or down, for example using a 
zooming lens or by suitable control of an SLM which generates the light. 

Compression of color images may be achieved by converting the image from an RGB 
format into a YUV format (if it is not already so represented) and then compressing each of the 
Y, U and V components. Typically, only the Y component is compressed at a full spatial 
resolution, while the U and V components are compressed at half their spatial resolution. In 
one preferred embodiment of the invention, different hardware is provided for the different 
components. Alternatively, the same hardware is used, sequentially. Alternatively, other color 
component separation methods may be used. 

In a preferred embodiment of the invention, an image sequence, such as a video 
sequence is compressed utilizing the above methodology. In a preferred embodiment of the 
invention, each of the images in the sequence sequences is compressed in turn using the above 
method of JPEG compression, providing a series of JPEG compressed images. In a preferred 
embodiment of the invention, inter-frame compression is achieved by motion estimation for 
example using adaptive differential coding by subtracting consecutive images. In a preferred 
embodiment of the invention, consecutive images are subtracted using an SLM which is driven 
with a previous image's density distribution. In a self-electro-optic effect device, the SLM can 
be programmed directly using the previous image, without requiring external electronics to 
store or otherwise manipulate the image. 

In some corifigurations, especially those using lower quality optics, light from one 
group of pixels (i.e., an 8x8 block) pixel may spill into an adjacent group, adding noise to the 
processing process. In some cases, but not typically, even leakage between two adjacent pixels 
is a problem. In some preferred embodiments of the invention, this issue is tackled by 
separating light in adjacent channels (pixels), so as to reduce the probability, degree and/or 
intensity of overlap. 

In some preferred embodiments of the invention, the separation is achieved using 
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spatial separation. In one preferred embodiment of the invention, a light absorbing material is 
provided between adjacent groups or pixels (e.g., on SLM, CDD or in optical path between 
them). 

Fig. 5B is a schematic cross-section of a channel separation method in accordance with 
a preferred embodiment of the invention. A device 1 14 comprises a plurality of channels 116. 
The channels are separated by absorbing columns 115. In one embodiment of the invention 
(not shown) the columns are solid. However, light may reflect off the side of such a solid 
column. Thus, in a preferred embodiment of the invention, each of columns 115 comprises a 
plurality of spaced apart absorbing portions 117. When a near parallel ray of light hits such a 
portion (as shown by arrow 118) the ray is likely to hit the absorbing material at a near 
perpendicular angle, assuring a high absorption. In one particular implementation, a plurality 
of layers 119 are provided, each layer having at least one absorbing portion 117 defined 
thereon. Layers 119 are stacked to achieve the configuration shown in Fig. 5B. portions 117 
may be the thickness of a layer, in which cases the layers are preferably arranged so that 
portions 117 of two contiguous layers are not aligned. Alternatively, portions 117 are shallow. 
In some embodiments, a generous spacing between portions 117 is provided, so that light will 
be less likely to be reflected off the sides of portions 117. Alternatively or additionally to 
spacing, portions 117 may have a sawtooth pattern defined thereon which has a face 
substantially perpendicular to light rays 118. Although absorbing portions 117 are shown to 
have a face perpendicular to main path of the light, other angles may also be used 
advantageously, for example to provide faces which are perpendicular to off-axis light rays, 
such as light ray 118. 

Alternatively to light absorbing material, beam forming elements may be provided to 
maintain the light beams in paths corresponding to their individual channels. Alternatively or 
additionally, light from adjacent groups or pixels may be separated using divergent optics, so 
that there is dead space between the individual beams. Alternatively or additionally, inactive 
CCD or SLM elements may be used so that the pixels are generated and/or detected in spatial 
separation. Alternatively or additionally, non-square pixels are used, for example circular 
pixels, so that there is less contact between adjacent pixels. Alternatively or additionally, the 
pixel groups are mapped onto non-square regions, for example circles, to minimize overlap. 

Alternatively or additionally to spatial separation, temporal separation may be 
practiced. In one example, the image plane is separated into two or more sets of pixels such 
that there is spatial separation between pixels (or specific groups thereof) of each plane, within 
the plane. Then the two planes are processed at a relative temporal delay, to reduce inter-pixel 
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interactions. The separation may be achieved, for example at the SLM or at the detector. 

Alternatively or additionally, frequency separation may be practiced, with adjacent 
pixels or other pixels in danger of overlap having different wavelengths of light. 

Alternatively or additionally, polarization frequency may be practiced, for example 
adjacent pixels using light polarized at 90° relative to each other. Preferably, each pixel 
utilizes two polarizers, one when it is generated (or later in the optical path) and one when it is 
detected (or earlier in the optical path). Possibly, source polarization is provided by the SLM, 
in addition to or instead of a separate polarizer. 

In the above separation methods, different configurations may be used based on the 
expected degree of leakage of light. For example, in a simplest case, the separation is in a 
checkerboard pattern having alternating "black" and "white" pixels, with the "black" pixels (or 
pixel groups) being one channel type (e.g., polarization angle, frequency, time delay), and the 
"white" pixels having a second value. Alternatively more than two channels are used, for 
example if leakage of a pixel to a distance of more than one pixel is expected. In the example 
of polarization, the relative angle may be selected to be 70°, rather than 90°. 

Fig. 6 is a simplified schematic flowchart of a base-line method 120 of MPEG- 
compliant compression, which flowchart does not show various feedback loops often utilized 
in the MPEG compression method. One of the main advantages of the MPEG compression 
method over the JPEG compression method is that the MPEG method takes into account 
similarities between consecutive images. One of the main tools for similarity determination is 
motion estimation, in which the motion of portions of the image are determined, so that an 
image can be reconstructed from spatially translated parts of previous images. Transmitting 
only the amount of translation usually requires less bandwidth than transmitting coefficients 
for an entire block. Thus, in an exemplary method, input data is transformed using a DCT 
transform (122). Motion estimation is performed (124). The resulting coefficients of 
translation data is quantized (126), encoded (128) and combined with a header (130) to form a 
data stream. 

In a preferred embodiment of the invention, alternatively or additionally to performing 
the DCT step using optical processing methods, also the motion estimation is performed using 
optical processing. In a preferred embodiment of the invention, motion estimation is 
performed by performing an autocorrelation of the source data with itself, allowing small 
amounts of block motion, using well known optical means, to determine block motion. 
Alternatively however, a DCT based motion estimation scheme is used. Thus, a same or 
similar hardware as used for the DCT may also be used for at least part of the motion 
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estimation. A method of motion estimation using DCT is described in a Ph.D. Dissertation 
titled "Low Complexity and High Throughput Fully DCT-Based Motion Compensated Video 
Coders", by Ut-Va Koc, presented in 1996 to KJ. Ray Liu of the institute for systems research 
and sponsored by the National Science Foundation Engineering Research Center Program, the 
University of Maryland, Harvard University and Industry, in U.V. Koc and KJ.R. Liu, "Low- 
Complexity Motion Estimation Techniques", U.S. Patent No. 5,790,686, issued August 4, 
1998 and in U.V. Koc and KJ.R. Liu, "DCT-Based Motion Estimation", IEEE Trans, on 
Image Processing, Vol. 7, No. 7, pp. 948-965, July, 1998, the disclosures of which are 
incorporated herein by reference. The method described therein can be summarized as follows 
(based on table 4.2 in the Ph.D. dissertation), with the DCT portions preferably being 
performed as described herein. Preferably, other elements of the process are also implemented 
using optical components, for example peak finding. 

a. Compute the 2D DCT coefficients of second kind (2D-DCT-H) of an NxN block of pixels at 
the current frame t, (x t (m,n); m,ne {0, . . . ,N- 1 > } . 

b. Convert stored 2D-DCT-II coefficients of the corresponding NxN block of pixels at the 
previous frame t-1, {x^m,^; m,ne {0,...,N-1}} into 2D DCT coefficients of first kind (2D- 
DCT-I) through a simple rotation unit T. 

c. Find the pseudo phases {gCS(k,i) ; k=0,l,..,N-l;l=l,2,..,N} and {g sc (k,l); 
k=l,2 5 ..,N;l=0,l,..,N-l}, which are calculated from the DCT coefficients independently at each 
spectral location. 

d. Determine the normalized pseudo phases f(k,l) and g(k,l) from gCS and gSC by setting ill- 
formed pseudo phases to zero. 

e. obtain the inverse DCT (2D-IDCT-D) of f(k,l) and g(k,l) as DCS(m,n) and DSC(m,n) for 
m,ne {0,..,N-1} respectively. 

f. Find peaks in DSC and DCS, which peak positions represent the shift amounts and peak 
signs represent the direction of movement. 

g. Estimate the displacement from the signs and positions of the found peaks. 

It is noted that even in this method of motion estimation, some processing is required 
beyond the DCT, however, a significant portion of the computation may be dealt with by DCT 
or IDCT transfonning of the data (in parallel or in sequence for each block). In a preferred 
embodiment of the invention, the previous image and/or its DCT coefficients are stored and/or 
provided using suitable electronics. Possibly, the optical DCT transforming elements are used 
for performing DCT and IDCT. Alternatively to the above method of motion estimation, direct 
correlation of image blocks may be used to estimate motion, for example, using image 
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correlation optical systems known in the art as part of the compression process. 

The above description has centered on compression, however, it should be noted, that 
decompression is very similar to compression and can often utilize similar or the same 
hardware. In the example of JPEG, DCT (for compression) and inverse DCT (for 
5 decompression) can be performed using a same optical transform element. In the example of 
MPEG, motion compensation, i.e., recreating images by compensating for the effect of 
motion, which motion was determined using motion estimation, can utilize a similar DCT- 
based method, also described in the above doctorate. It is noted that for some decompression 
methods, there is a requirement for some processing before the transforming of coefficients 
10 into an image domain. For example, in JPEG de-compression, the compressed image data is 
un-runlength encoded and de-quantized prior to being IDCTed. As with compression, these 
processing steps may be performed optically and/or electronically, depending on the 
implementation. 

Fig. 7A is a schematic diagram of a direct-compression camera system 200, in 

15 accordance with a preferred embodiment of the invention. In system 200, an image of a real 
object 202 is acquired directly as transformed and/or compressed data, rather than being 
acquired as image data which is later compressed. There are many applications in which an 
image is acquired in order to be stored on a digital media or in order to be transmitted over 
bandwidth-limited transmission lines. Examples of such applications include digital cameras, 

20 security cameras, teleconferencing systems, live-feed TV cameras and video-telephones. In a 
preferred embodiment of the invention, the data is acquired in a compressed manner, using the 
above described methods of compressing optical data, except that it is preferably the original 
optical waves, arriving from the object, that are compressed, rather than an electronic 
representation which is separately acquired and compressed. 

25 In the exemplary system of Fig. 7A, an optional object lens 204 focuses and directs the 

light form object 202 onto a DCT lens (or lens matrix) 206. Lens 206 may also comprise other 
optical elements which perform further steps of the image compression method. The processed 
light is collected by a CCD 208 and then further processed and stored in a storage 210. In real- 
time embodiments, the acquired data may be transmitted, instead of or in addition to storage. 

30 The compression method performed may be a method suitable for still images, such as JPEG 
or a method suitable for moving images. 

In a preferred embodiment of the invention, DCT lens 206 is designed to operate on 
white light. Alternatively, the light arriving from the scene is filtered so that it is monochrome. 
Alternatively or additionally, the image is acquired under controlled lighting situations, so that 
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the light has known characteristics, such as being coherent, monochromatic or formed of a 
small number of narrow spectral bands. Alternatively or additionally, the image is acquired 
using a monochromatic light, possible a laser flash, so that the characteristics of the light are 
controlled by system 200. Such controlled lighting is especially useful for low-light level 
5 cameras, such as those using GICCD (Gated Intensified CCD) technology. Also, the use of 
coherent light simplifies the use of hologram-based image processing techniques. 

Alternatively or additionally to an objective lens 204, a light encoding module, such as 
a combination CCD/SLM may be used, to convert incoming light into light having desired 
spatial and spectral characteristics. Alternatively or additionally, a self-electro-optical effect 
10 shutter is used, in which the impinging light is used to modulate the transmission of last or 
other controlled light. 

Fig. 7B is a schematic block diagram of a YUV-separated implementation 220 of the 
embodiment of Fig. 7A. Color images may be compressed by separately compressing each 
color component, or more commonly, each of the YUV components. These components may 

15 be determined using a look-up table or by simple arithmetic on the R, G and B components of 
an incoming image. These separations may be performed using optical means and/or electronic 
means, shown generally as a splitter 222. Each of the resulting color components (224) is then 
processed separately, using a dedicated DCT 206 and a dedicated CCD 208. The results are 
then added using a combiner 226. It should be noted that the U component and the V 

20 component are usually processed at a lower resolution than the Y component. Thus, the U and 
the V can share optical components. Alternatively or additionally, all three components are 
processed using a single optical path, for example on different parts of a same lens-CCD set. 
Alternatively or additionally, the three components are processed sequentially. 

A component which performs image compression or decompression may be packed in 

25 various ways, depending on the application. In one application, a PC graphics card includes an 
optical processor for aiding in displaying MPEG images. In another example, a CCD camera 
includes an MPEG or a JPEG optical module so that they can provide a compressed data 
output as well as a standard data output. 

In a preferred embodiment of the invention, the above described optical elements are 

30 provided embedded in a transparent substrate, such as a clear plastic or glass, so that once the 
elements are coupled, there is no relative movement due to vibration, heat or other external 
forces. It should be noted that pixel-sized transverse shifts in the optical elements do not 
substantially affect the output, providing the SLM can be controlled to shift its image by the 
pixel shift error. In a preferred embodiment of the invention, the optical elements are 
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manufactured and tested without a surrounding matrix or with a liquid surrounding matrix, 
which is then solidified when the relative positions of the optical elements are determined. In a 
preferred embodiment of the invention, the optical processor is calibrated by entering known 
data and measuring the compressed output. 

Fig. 8 is a schematic diagram of a lithographic implementation of an optical 
compression system 300 in accordance with a preferred embodiment of the invention. An 
advantage of lithographic optics is that they can be fabricated in large batches, and, depending 
on the process, in conjunction with the forming of electronic circuits on a same substrate. It 
should be noted that most lithographic implementations utilize reflective optics rather than 
transmissive optics. The above description has focused on transmissive optics, however, 
reflective optics can also be used for non-lithographic optical processors. Various lithographic 
implementations will occur to a person skilled in the art, however, an exemplary embodiment 
is shown in Fig. 8. 

System 300 comprises generally of a substrate 301, one or more reflective surfaces 303 
which are etched and/or otherwise lithographically processed or micro-machined to form 
reflective optical elements and an interposing clear medium 305. An SLM or a diode array 302 
is used to provide an image. The light is reflected off substrate 301 to a reflective DCT lens 
304. The transformed light is reflected back to substrate 301 and then to a CCD or other 
optical array detector 306. Optionally, the CCD array or other optical, electrical or electro- 
optical elements may be formed directly on the substrate, for example as indicated by 
reference 308. In one example, a quantizer, or a holographic reflecting lens are formed at 
location 308. Possibly, reference 308 indicates an active element, such as an LCD array. 
Alternatively or additionally, diffractive or refractive elements, for example bi-refringent 
calcite crystals as described below, may be used in part of the construction of system 300. 

In a preferred embodiment of the invention, device 300 is manufactured to DCT a 
single 8x8 block rather than a whole image. A plurality of systems 300 is preferably used to 
compress an entire image. Alternatively, system 300 is manufactured to process a single vector 
rather than an array. Although system 300 may form a part of a dedicated JPEG or MPEG 
decoder or encoder, in a preferred embodiment of the invention, one or more system 300 type 
elements are used for the construction of digital signal processor or other integrated circuits, 
for example to assist in high-end graphical applications. 

In one preferred embodiment of the invention, a reflective SLM is coupled directly to a 
back of a CCD camera. Thus, cheaper, more efficient and/or faster circuitry can be used to 
couple light input at the CCD to encoding of light reflected by the SLM. In one example, the 
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CCD-SLM sandwich can encode laser light using light from an external object, which 
impinges on the CCD. In another example, electronic circuitry sandwiched between the SLM 
and the CCD can perform various electronic processing steps, as suggested herein. Typically, a 
highly parallel architecture can be achieved, so a higher than standard throughput is envisioned 
for some implementations. Several variations of such an SLM, especially with the capability of 
processing the data between the CCD and the SLM, are described in US patent 5,227,886, the 
disclosure of which is incorporated herein by reference. These SLMs can use parallel 
connections between the CCD elements and the SLM elements or serial connections. 

The above description has centered on DCT based compression methods. However, 
other transform based compression methods may also be implemented in accordance with 
preferred embodiments of the invention. In one example, a wavelet compression method is 
implemented using a block DWT (discrete wavelet transform). Possibly, there is an overlap 
between blocks. Such a transform is described, for example in G. Strang and T. Nguyen, 
"Wavelets and Filter Banks", Wellesly-Cambridge Press, 1997, pp. 502, the disclosure of 
which is incorporated herein by reference. Preferably, such a wavelet compression 
implementation includes bit-plane coding techniques such as SPIHT or EZW, possibly 
implemented using a lookup table. 

The above description has centered on image compression, however, in accordance 
with a preferred embodiment of the invention, optical components are used for compressing 
other types of signals, for example, audio signals. It is noted, however, that image compression 
is generally more suitable for transform based compression and being two-dimensional, is 
more computationally-complex to compress than other types of data. 

In the above detailed description, various types of optical data representations are 
suggested, as well as various types of optical systems. In a preferred embodiment of the 
invention, the optical representation used is selected to match the optical system, for example, 
an analog representation for an analog system, in some cases, the data may be converted 
between representations, to take advantage of particular optical configurations, for example 
digital optical data may be converted into analog optical data to use a particular lenslet-based 
implementation of a DCT transforming element. 

Many different types of SLMs may be used to practice various embodiments of the 
present invention. However, in a preferred embodiment of the invention, a binary SLM is used 
for practicing the present invention or even for performing linear transforms in other 
applications. In a preferred embodiment of the invention, the data is separated into bit planes 
and each bit plane is processed separately. Then the bit planes are combined to yield the 
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processed result. The following equation describes the relationship between the Fourier 
transforming of bit-plane separated and unseparated data: 



This equation is correct for all linear transforms. In a preferred embodiment of the 
invention, the data is separated into bit-planes using an electronic circuit, however, also optical 
means can be used. The data may be represented in several different ways, depending on the 
specific application, including, spatial encoding where adjacent pixels represent different bits 
and temporal encoding, where the different bits are temporally separated. Combinations of 
temporal and spatial separations may also be used. In spatial separations, the bits may be 
arranged so that the MSB is surrounded by lesser significant bits, so that cross-talk between 
pixels (groups of bits) will be less likely to cause a modification of the MSB. An alternative 
binary representation uses separate optical channels (or channel portion) for the different bit 
planes. 

After processing, the processed bit planes may be combined using optical or electronic 
means. The optical means may be analog or digital. One example of an optical combining 
means is using a weighted mask which reduces the intensity of light from each bit plane 
response to the bit position and then all the light is directed to a single CCD pixel. Another 
example of combining is having each bit illuminate a different CCD pixel and then performing 
weighted addition on the pixels. Alternatively or additionally, different bit planes may be 
generated with different intensity values depending on the bit position. 

It is contemplated that the use of a binary SLM may be advantageous also for other 
application using optical processing, for example radar signal processing. By using high speed 
modulation of parallel data beams, a higher system clock can be provided, possibly even 
providing a better throughput than electronic processors of a similar size, cost and/or heat 
dissipation. 

Alternatively to a two-level SLM, three-or higher numbers of discrete levels may be 
provided at the SLM. Alternatively or additionally, although a radix based separation and 
combination of data is described, other methods can be used to separate the data and 
recombine it. In one example, a set of optionally orthogonal basis vectors are used to separate 
the data and recombine it. Such a set of basis vectors may be arbitrary. Alternatively, it may be 
designed for other reasons, for example, for noise reduction, for distributing noise evenly 
between bits and/or for matching the basis vector set to a system characteristic, such as a 
system MTF. 
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In some cases, the SLM is faster than the propagation time in the processor. Preferably, 
the processor is treated as a pipe-line in which the SLM and detector are not processing the 
same data, but rather there is a delay between the SLM and the CCD. Multiple data streams 
may also be utilized using different frequencies of light In some cases, either the SLM or the 
5 CCD will be faster. Preferably, several instances of the slower element are provided in order 
not to slow the pipeline. Light from a plurality of SLMs can be collimated to a single optical 
path and, conversely, light from a single optical path can be projected or copied to a plurality 
of CCDs. Such mixing and copying is especially useful when different data streams are 
implemented using different frequencies of light. However, such frequencies may also be 

10 differentiated using an active optical filter such as an LCD-color filter-polarizer combination. 

The optical processing hardware is preferably dedicated for particular tasks. 
Alternatively, in some preferred embodiments of the invention, the same hardware 
components may be used for different steps in a process (such as a DCT component for 
compression and for motion estimation), for different processes (such as compression and 

,15 decompression) and/or for different data blocks in a same process, such as in serial processing 
; of data blocks). Alternatively or additionally, the hardware may be programmable, at least to 
some extent. For example, by modifying the behavior of an SLM and a CCD which form part 
of a Fourier-based data transform optical component, different type of transforms can be 
achieved with a single hardware, for example, DCT and DST. Alternatively or additionally, 

20 the matching layer may be programmable, for example being an addressable LCD, so that the 
size and/or location of pinholes can be controlled. Alternatively or additionally, by controlling 
the opacity of single LCD cells, different continuous spatial filtering configurations can be 
achieved. 

In some preferred embodiments of the invention, the above transforming of data or 
25 other processing of data are performed using other optical and electro-optical effects, for 
example bi-refringent calcite crystals as used in switching networks. Such crystals and 
exemplary uses are described, for example in "All-Optical Reduced State 4x4 switch", by Dan. 
M. Marom and David Mendlovic Optics and Photonics News March 1996, p. 43, in "Optical 
Array Generation and Interconnection Using Birefringent Slabs", Tomas W. Stone and James 
30 M. Battiato, Applied Optics, Vol. 33 No. 2, pp. 182-191 January 1994 and in "Cantor 
Network, Control Algorithm, Two-Dimensional Compact Structure and its Optical 
Implementation", by Ning Wang, Liren Liu and Yaozu Yin, Applied Optics. Vol. 34 No. 35 P. 
8176-8182, December 1995, the disclosures of which are incorporated herein by reference. 

In one preferred embodiment of the invention, an optical processing component is 
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designed to implement a DCT algorithm by simple manipulations of light, such as splitting, 
adding, subtracting and/or multiplying by various factors. DIF (decimation in frequency) or a 
DIT (decimation in time) algorithm are considered to be especially suitable in accordance with 
a preferred embodiment of the invention. However, many other algorithms are known for 
5 calculating a DCT and may be implemented in accordance with other preferred embodiments 
of the present invention. Figs. 9B and 10 describe an implementation using calcite crystals, 
attenuators, phase retarders and polarizers to achieve these effects. However, other optical 
elements may be used instead, for example diffractive optics. 

Fig. 9A is a flowgraph for performing a 8x1 DCT-n using a DIF type algorithm. In the 

10 DIF and DIT representations, the input data points are rearranged so into groups, each of 
which can be recursively evaluated using a lower-order DIF or DIT algorithm Reference 390 is 
a 8x1 DCT which uses two 4x1 DCT components, indicated by a reference 392. A copy of this 
figure can be found in "DCT-applications and Algorithms" by P. Yip and K. R. Rao 
(Academic Press, 1990), page 61, the associated discussion (pp. 56-61) being incorporated 

15 herein by reference. Figs. 9B and 10 illustrate one possible implementation of these 
flowgraphs. It is noted that due to the differences between optical elements and line diagrams, 
in some cases single operations are spread out between several optical components or plural 
operations are combined in a single optical component. Also, although the example shown is 
of a DCT process, similar embodiments may be used for DFT (discrete Fourier transform) and 

20 for DWT (discrete wavelet transform). 

Fig. 9B is a schematic figure of a calcite based DCT transforming optical element 400, 
in accordance with a preferred embodiment of the invention. Eight beams or circularly 
polarized light, each representing one pixel of an 8 pixel vector are split into two sets of beams 
by a first calcite crystal 402. One set of beams "ordinary rays" comprise the light that is 

25 polarized at 0° to the calcite polarization axis. The other beams, "extraordinary rays" comprise 
light polarized at 90° to the axis. It should be noted that as the beams are processed, they stop 
corresponding to the original pixels, however, for convenience, the separate beams of light are 
referred to in the order in which they are shown in the figure. It should be noted that in some 
cases, fewer or more beams may be active during the DCT processing stage, even if both the 

30 input and the output are for eight rays of light. Four of the split beams (pixels 4-7) are 
recombined with the other four beams (pixels 0-3) and then polarized by a linear polarizer 404 
at 45° and converted into zero axis polarized light by a A/4 plate 406. This completes a parallel 
shift and addition operation on all the pixels. These beams are then spatial recombined with 
the original beams for pixels 0-3 using a second calcite crystal 408. However, two 
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polarizations are transmitted by crystal 408, the 90° light being further shifted by the following 
crystal (410). A third calcite crystal 410 is used to combine the beams of pixels 0-3 with phase 
delayed beams of pixels 4-7, which pixel beams are retarded using a X/2 phase plate 412. The 
result of the combination is attenuated using an attenuator 414, polarized using a polarizer 416 
5 and then converted into circularly polarized light using a X/4 plate 418. Each of pixel sets 0-3 
and 4-7 are then processed using a DCT-II 4 bit element 420 or 422, described in Fig. 10. 

The output of elements 420 and 422 are further processed to yield the final DCT. 
Beams 4-6 are retarded using a X/4 retarding plate 424 and then combined with beams 5-7, 
using a fourth calcite crystal 426. Beams 5-7 then sum up their two polarizations using a 45° 
10 polarizer 428, to yield the DCT result in eight beams. 

Typically, but not necessarily, a 2D DCT is desirable. One way of generating a 2D 
DCT is to apply a DCT to the rows and then process the result by columns. This can be 
achieved, for example, by chaining two system 400, where one is perpendicular to the other, 
thus performing first row transforms and then column transforms. Phase information is 
15 maintained by the light, so there is no need for separate circuitry to support chaining two DCT 
elements. A X/4 retarder 429 is preferably provided on beams 5-7 of the first system 400, to 
support the chaining. 

In a preferred embodiment of the invention, the system is implemented as a 2x4 array, 
rather than as a 1x8 array. In one calculated embodiment the system is about 27 times as long 

20 as the width of each of the calcite crystals. It is noted that the input and output are not in pixels 
order. In a preferred embodiment of the invention, the pixel order is generated by suitable 
wiring of the SLM or of the CCD. In a 2x4 folded embodiment, the required length is 
calculated to be 18 times the width. It should be noted that the required length can vary by a 
significant factor depending on engineering considerations, such as materials, folded optical 

25 paths and noise considerations. 

Fig. 10 is a schematic figure of a 4 pixel DCT element 440, such as elements 420 and 
422 of Fig. 9B. Letter indications a-d are used to avoid mix-up with pixel beams 0-7 of Fig. 
9B. Again it is noted that as beams a-d are processed, they loose their original meaning and are 
simply used to designate the ordinal location of the beam in the figure. Beam d is retarded 

30 using a X/2 retarder 442, then beam c is combined with beam d using a calcite crystal 444. The 
resulting beam c is retarded again using a X/2 retarde6 447 and then split into beam c and beam 
d using a second calcite crystal 447. Thus, the data in beams c and d is exchanged. A X/4 
retarder 448 is applied to all the beams, converting them to 45° polarization. Beams c and d are 
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combined with beams a and b using a calcite crystal 450, thus implementing addition 
operations a+c and b+d. The resulting beams a and b are then combined with the original 
beams a and b, using a calcite crystal 456, after the result beams being first polarized using a 
polarizer 452 and then retarded using a A/4 plate 454. Beams c and d are delayed using a phase 
5 plate 457 and then have beams a and b combined with them, using a calcite crystal 458. This 
completes a subtraction operation between the original beams - a-d and b-c. The resulting 
beams c and d are attenuated using an attenuator 460, polarized using a polarizer 462 and 
retarded using a A/4 retarder 464. Beams b-d are then combined with beams a-c, using a calcite 
crystal 466. 

10 At this point in the process, each pair of beams is processed to yield a 2 input DCT. 

Beams a and c are polarized using a polarizer 468 and retarded using a A/4 retarder 470. A 
calcite 472 combines the pre-466 crystal a beam with the current a beam and spatially 
combines the b beam with the current c beam, although they do not have the same polarization 
and are separated by the next calcite. Beams b and d are delayed using a phase plate 474. A 

15 calcite 476 combines beams a and c into beams b and d. Beams b and d are attenuated using an 
attenuator 478, beam b is polarized using a polarizer 480 and then beams b and d are retarded 
using a A/4 retarder 482. A calcite crystal 484 is used to combine beam d into beam c. The 
resulting beam c is polarized using a polarizer 486 and is retarded using a A/4 retarder 488. A 
calcite crystal 490 spatially combines beam c into beam b. A A/2 retarder 492 retards beam b 

20 and a calcite crystal 494 splits out the pre-490 beam c. Elements 490-492 are used to exchange 
the polarization states of beams b and c. Beam c is then retarded using a A/2 retarded 496, 
generating the DCT result. 

The description of Figs. 9B and 10 have focused on non-programmable embodiments. 
However, it should be noted that bi-refringent switching networks usually include active 

25 elements, which allow outside control of their behavior. An example of such an element is a 
liquid crystal cell which can selectively (on the application of an electric field) rotate the 
polarization of a light ray. Another example is a beam switching element which selectively 
swaps two beams. In some embodiments of the invention, such controllable active elements 
are used to allow programming of the device, however, in other embodiments this is not 

30 required. Programrning is especially useful for allowing a single component to function in 
different ways for example for different image portions, for compression or decompressing 
and/or for different steps of processing. 

It will be appreciated that the above described methods of optical processing may be 
varied in many ways, including, changing the order of steps, which steps are performed using 
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electrical components and which steps are performed using optical components, the 
representation of the data and/or the hardware design. In addition, various distributed and/or 
centralized hardware configurations may be used to implement the above invention. In 
addition, a multiplicity of various features, both of methods and of devices, have been 
described. It should be appreciated that different features may be combined in different ways. 
In particular, not all the features shown above in a particular embodiment are necessary in 
every similar preferred embodiment of the invention. Further, combinations of the above 
features are also considered to be within the scope of some preferred embodiments of the 
invention. In addition, the scope of the invention includes methods of using, constructing, 
calibrating and/or maintaining the apparatus described herein. When used in the following 
claims, the terms "comprises", "comprising", "includes", "including" or the like mean 
"including but not limited to". 
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1 , A method of date, processing, comprising: 

providing image-date encoding light as a spaced-apart discrete input set with dead 
5 spaces between all input set elements: 
r : transforming said light from an image space to a. ttansfotm space utilising a continuous 

optical Fonder ttaMfchning component tb apply a discrete linear transebxro. to said input 
^ discrete dsta set, which transform generates coefficients that inter-relate a plurality of input set 

slsmeiitsi and 

10 detecting data carried by said transformed light as discrete data, hy a spatially discrete 

sampler wMck detects spaced apart samples. , 

1. A method according claim I, wherein said transform is -signed, 

15 3 - A method according to claim 1, Wherein, said txms&ixm is two dimensional. 

J* 4. A method according to any of claims 1-3. comprismg matching Baid continues 

fU component to a discretization behavior of said discrete sampler using a. matching componetLt 

Jg; 20 5. A m<rfh.od according to claim 4„ -wijesrudu said matching component conipxises an array 
ofbmary apertusea. 

jyl 6. A method according to claim 4, wherein, skid niatrfaiag conrpoaeut coTTjpxises an array 

% of multi-density masking elements. 

3 25 

- ? 7. A method according to any 'of claims 4-6, wherein, said image data caicodiog light is 

provided as a set ofpoint sources. 



8. A method according to any of claims 1-7. oomprismg compressing: or decampressjiig 
3D said data using a transform-type compression/decomprrasioiL method tiaat uses said 

traiisibTTniTig- 

9. A method according to claim 8, comprising convening said data into electrical signals. 
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10- A method according to claim. 9, wherein, said, converting comprises quantization 

11, A method according to any of claims 8-10, 'wherein said trsnsfbmmig comprises 
5 transforming using oat or more optical elements which perform a block transform. 

L2. AmeUiod aucording to chum. 11, whtedta said one or mote optical elements camprisss 
a matrix of optical teas dements. 

10 13. A method according to claim 12, wherein at least one of said optical lens elements 
comprises a lenslet array which performs a block tnms&im for a single block. 

JA A method according to oh m 11, wherein said one or more optical elements comprises 
an dement which performs a vector by maids multiplication. 

15 

15. A method according to claim 11> wherein. said one or more optical element comprises a. 
refractive element 

16". A mefhod according to claim 15, wherein said refractive element comprises a bi- 
20 TffifHng fcnT. marq-iaT , 

17. A method aiMordiag to claim, 15 or claim 16, wherein said retractive element splits and 
combines beams representing individual data elements of said dais. 

is is. A method according to claim 11, wherem said, one or more optica] elements comprises 
an element wjneb generates a matrix pro duct 

19- A method according to claim 1 8, wherein said matrix product comprises a t&pfc matrix 
product 

30 

20. A method according to claim II, 'wherein said ti^fiirming Utilizes at least one 
electrical component Jot transferring dsta between aaid a£ least one optical component. 

41 
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'21. A method according to aay of claims S-20, wherein said compression is a. JPEG 
compression. 

22. A method according to any of claims S-20, wherein said compression, is a MPBG 
5 compression, 

23. A method according to sny of claims wherein said compression is a wavelet 
compression. 

10 24. A method according to any of claims S-20, Whsrem said data represents an jmags 
sequence. 

25. A method according to any of clams 1-24, wherein said prowling comprises providing 
data encoded using discrete levels, 

15 

26. A method according to clsdm 25, wherein the data is provided as binary encoded data, 

27. A method according to claim 25, wherein the dsla. is provided using a "base three 
representation, 

. 23. A method according to any of claims 1-7, wherein said teartsfoim coTnprises a block 
transform. 

29- A method according to any of claims 1 -7 or 28. wherein optical component is .an atomic 
25 optical clemeiai, 

30. A m&inod according to any of claims l-l or 2S 5 whwBin said optical component 
comprises a plurality of optical components. 

30 31. A method according to any of clsdms 1-7 or 28-30, wherera said optical component 
comprises a discrete optical processing element 
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32. A method according to any of clams 1-7 or 28-3 l s wherein said treosibxirj is a JPEG- 
DCTtransfonn- 

33- A. method according to any of claims 1-7 or 28-31 , -wherein said transform is sa inverse 
3 DCT tamsfonn. 

34. A method according to any of claims 1-7 or 2S-33, comprising post-processing said data, 
to genoste data that represents a transform after than a Fourier transform. 

10 35. A method according to clarai 34, -wherein said postprocessing comprises optically 
postprocessing. 

36*. A method according to claim 34 or claim 35, "wherein said postprocessing comprises 
spatially mod-dating said light 

15 

37. A method according to claim 36, whsteaii seid spatially modulating comprises 
conlimiousry varying aa amplitude of said data. 

38. A method according to any of claims 34-37, wherein said preprocessing comprises 
20 imirrorias said data. 

3 9 . Apparatus for optically processing data, comprising: 
aa rnptrt fox recervmg ^afg; 

a spatially modulated light source responsive to said input for presenting said input as a 
2S spaced apart discrate ijpur set with, dead spaces between all input set elements; 

at leaat onft continuous Fourier trantformmg optical ccnnpcmect far transforming said 
data brtwaeji an image apace and z. transform space, nsiag a two dimensional signed discrete 
linear transform; and 

a, spatially discrete, sampler for sampling ai locations corresponding to said discrete 
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40, Apparatus according to claim 29, wherein said received data comprises uncompressed 
image data and comprising a processor for processing said data after said transform to yield 
compressed image data to be oulputleA 

5 41. Apparatus according to claim 39, wherein said received data comprises compressed, 
image carta and comprising a processor ibr processing said date, before said transform to yield 
transfonn. data to be traosformedby said optical component 

42. Apparatus according to daim 41, wherein smd processor includes an optical D/A 
to converter. 

43. Apparatus according to claim 41, wherein Said processor comprises an optical 
multiplier for de-quantizing data. 

15 44. Apparatus according to claim 40 or claim 41, -wherein said processor performs at least 
some of its processing on optic -waves. 

45. Apparatus acrording to any of claims 40-44, wh«r«a said processor performs at least 
somi of its processing otj electronic signals. 

20 

46. Apparatus according to any of claims 3 9-45, comprising an optical motion estimator. 

47. Apparatus according to clam 46, Wherein said optical motion estimator utilises said 
optical component for optical motion estimation. 

25 

4S. Apparatus according to claim 46 or claim* 47 s wfaerein said optical motion estimator 
includes at least one electronic component. 

43. Apparatus according to any of claims 39-47, wmprisiog an optical motion 
30 compensator. 

50. Apparatus according to claim 49, ^nerein said optical motion compettsaior utilizes said 
optical component for optical motion compensation, 

44 
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51. Apparatus according to claim 49 or claim 50, wherein Said optical motion compensator 
includes si least one electronic componeni 

5 57- Apparatus according to any of claims 39-51, herein .said data is compressed using a 
JPEG compression, 

53. Apparatus according to any of claims 39-51, Therein said date is compressed using a 
wavelet compression. 

10 

54. Apparatus according to any of claims 39-51, wherein said dais, is compressed using an 
MPEG compression. 

55. Apparatus according to any of claims 39-54, wherein said data comprises m image 
15 sequence. 

56. Apparatus according to any of claims 39-53, wherein said data. i$ a single image. 

57. Apparatus according top any of claims 39-56, wherein said data i s Tnaru'pntoed as 
20 blocks, 

5?. Apparatus according to claims 51, wherein al least -two of said blocks are manipulated 
in parallel 

25 59. Apparatus according to claims 57, wbfittdn at least two of said blocks arc mampulaied 
in series and comprising a buffer circuit for directing said, blocks in series into a single optical 
component, 

60. Apparatus according to any of claims 39-59, wherein, said optical component comprises 
30 a holographic lm£. 

61. Apparatus according to any oi claims 33-60, wherein said optical component comprises 
an optical analog to digital converter, 

45 
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62. Apparatus according to any of claims 39-61 1 "Wherein said optical component eoxnprises 
an. optical digital to analog converter. 

5 ' 63. Apparatus according to 2ny of claims 39-62, wherein, said optical cornponsnt comprises 
a mairix product calculatrng dement- 

64. Apparatus aocordiag to any of claims 39-63, wherein said light source comprises a 
binary SLM (spatial light rnodolstoi). 

10 

65. Apparatus according to any of claims 39-64, wbareiii said input is matched to said 
output to account for non-point light sources and detectors. 

66. Apparatus according to any of claims 39-65, wherein said apparatus processes a 
15 plurality of data blocks k parallel. 

67. Apparatus according to claim. 66, wherein different data blocks are encoded diffeccntlv, 
to reduce cross-talk betwesa than. 

63. Apparatus according to claim 67^ 'wherein said different encodings comprises different 
polarizations. 

69. Apparatus accotdin* to claim 67, wherein said different encodings comprises different 
light frequencies. 

70. Apparatus according to any of claims 66-69, cojsfprising light attenuators arranged to 
attenuate light lealnng between, areas processing different dec blocks. 

71. Apparatus accor din g to claim 70, whercin.said attenuators comprises solid attenuators 
30 

72. Apparatus according to claim 70, wherein said attenuators comprises a plurality of 
atten.-oa.tor portions spaced apart along 4 msin propagation axis of light sash, thai leakage light 
impinges on said at least one of said attenuator portions at a substantially pcrpeadicTjlar angle. 

46 
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73. Apparatus according to claim 70, wfcsrem said, attenuators are ibjmed of at least one 
stack of transparent optical notorial having a plurality of light absorbing areas defined thereon, 
which light absorbing areas do not extend vertically in a. continuous maimer through said stack. 

5 

74. Apparatus according to any of claims 39-73, wherein said optical component comprises 
& bi-iejzjitgsnt material 

75 . Apparatus accoiciig to clarm 74, wherein said material comprises calotte. 

10 

76. Apparatus according to any of claims 39-75, wherein said optical component splits and 
combines light beams presenting separate darA elementa. 

77- Apparatus according to any of claims 39-76, wherein, said input receives light waves 
15 firm so imaged object and wherein said input spatially Hnrgples said light. 

7S- Apparatus according to claim 77, OTmprising a detector that converts said data into 
electrical signals 

20 79. Apparatus according to okim 78 s oorxrarising an optical quantizer wHch quantizes snid 
nsnsfomiedjight prior to its recepriailby said detector. 

SO. Apparatus according to claim 78, comprising an electronic quantizer which quantizes 
said electronic signals id produce compressed, data. 

25 

81. Apparatus according to claim 78, wherein said optical detector quantizes said tight 

82. Apparatus according b> any of claims 77-SL, comprising a storage unit for storing at 
least one set of said electronic signals, corresponding to a still image. 

so 

S3. Apparatus accexding to any of claims 77-81, comprismg a storage unit for Storing at 
least one set of said electronic signals, corresponding to an image sequence. 
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S4. Apparatus according to say of claims 77-83, wheraa said input 2nd said light source 
comprise a planar two dimensional imager sandwiched to a pkuar two dimensional reaccnv^ 
spatial light modulator (SIM). 

5 85. Apparatus according to claim 84. wherein individual cells of said SLM aie wired in 
parallel to individual calls of said planar imager. 

86. A method of optical motion estimation, comprising: 

provLding aSrstset of light waves encoding data, of a first image block; 
10 DCT trsnsiOTniiig said first set of light waves using an optical component; 

providing a second set oflighl waves encoding date, of a second image block; 
DCT im$forming said second set of ligftt waves using an optical coroponsnr; and 
processing said first and said second DCT transformed data sots to determine an amount 
of relative motion of said twt> blocks, 
15 -wherein said DCT ttarefhrrnrng optical component serves as part of a transform- 

compression system. 

S7. A ro.sth.od according to claim 86, wherein both, of said DCT teti,sfoxms utilize a same 
optical comportem for said, rranrforrniiig- 

20 

8S. A method according to claim 86 or claim 87, wherein said processing comprises 
electronically processing said transformed data sets. 

S9. A method according to any of cbime 86-88, comprising trnitzrng said determined 
25 motion for generating a compressed iaiBge stream, 

90. A single integrated nraM-bbok-ttansfoini. optical element, casspiising: 

a plurality of optical groups each group comprismg ai least one optical sub-element, 
wherein each of said optical groups optically transforms a block of data, using a. signed 
30 linear discrete transform, 

wbsreia said block is. part of a data set divided into blocks for block-trapgformmg, 
i^luding at least one oihar block being traos&rmed in parallel by another optical group of sai<5. 
integtated eleroeat and 

4S 
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said dola is atranged as a spatially impulse image. 

91. An eieanent according ta claim 90, wKerem said traasformis twcwJimensiojial. 

S 92. An. elsmeai accoxdiijg to claim 90 or claim 91, wherein said transform, is signed. 

An element according to any of claims 90-92, wBecein said optical groups parfbim said 
treusfDrming using a discrete optical 'iMfflpoKeaattiiat applies a Transfoim. 

10 94. An sternest according to any of claims 90-93, wherein, said optical groups. perform ss.i d 
la^formiag -using a conttauoos optical component that applies a transform. 

95. An deroenl according to any of claims 90-94, iwlicarera. said at least one sub-demeat 
cornpriseg a lenslet array portion. 

J 96. Am element according to any of claims 90-95, vAieaem said plurality of optical groups 

7\ _ twanged as a matrix. 

™ 97. An clKnent according to say of claims 90-96, wnsrein said element performs a JFE&- 

4 20 DCT transform. 



92. An element according to any of churns 90-96, wherein said element performs an invers& 
DCTti 



25 99. All element according to any of claims 90-9 5, -wieran said element performs a wa^e) sr 
rransjocni, 

1 00. An element according to any of daims 90-99, wherein sdd transform comprises a naa> 
separable transform _ 

30 

101. An element accordras to my of claims 90400, irimaaaid optical groups overlap. 
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102. A* clement according to my of claims 90-100, .aid optical mraps d 0 aoi 

overlap. 
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P.O. Box 5632, Caesaria 38900, Israel 



Full name of fifth inventor, if any 




Gal SHABTAY 




Fifth inventor's signature 


Date 


Residence 

9 Feldman Street, Petach-Tikva 49549, Israel 


Citizenship 




Israel 




Post Office Address 




9 Feldman Street, Petach-Tikva 49549, Israel 







Full name of sixth inventor, if any 



Sixth inventor's signature 



Residence 

lHermonStreet a Rpsh-Haavin 48560, Israel J^/JLs 

Citizenship 

Israel 

Post Office Address 

1 Hermon Street, Rosh-Haayin 48560, Israel 
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Full name of seventh inventor, if any 

Uriel LEVY 

Seventh inventor's signature 



*W if 



Residence 

9 Feldman Street, Petacfa-Tikva 49549, Israel XLX^ 



Citizenship 
Israel 



Post Office Address 

9 Feldman Street, Petacfa-Tikva 49549, Israel 



Fuii name of eighth inventor, if 
Nairn KONFORTI 
Eighth inventor's signature 

Residence 

36 Menachem Begin Avenue, Holon 5851 7, Israel 
Citizenship ~ "~ 

Israel 

Post Office Address ~ 

36 Menachem Begin Avenue, Holon 58517, Israel 



Full name of ninth inventor, if any 
Amir SHEMER 
Ninth inventor's signature 



Residence 

83 Bialik Street, Ramat-Gan 52513, Israel 

Citizenship 
Israel 

Post Office Address ' 
83 Bialik Street, Ramat-Gan 52513, Israel 



Full name of tenth inventor, if any 




Dan SHKLARSKY 




Tenth inventor's signature 


Date 


Residence 




9 Yona Angel Street, Haifa 34952, Israel 




Citizenship 




Israel 




Post Office Address 




9 Yona Angel Street, Haifa 34952, Israel 
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Full name of seventh inventor, if any 




Uriel LEVY 




Seventh inventor's signature 


Date 


Residence 

9 Feldman Street, Petach-Tikva 49549, Israel 


Citizenship 




Israel 




Post Office Address 




9 Feldman Street, Petach-Tikva 49549, Israel 







Fuil name of eighth inventor, if / c ^f/^" 
Nairn KONFORTI 






Eighth inventor's signature / 




Date 


Residence 

36 MenachemBegin Avenue. Holon 58517. Israel 






Citizenship 
Israel 


Post Office Address 

36 Menachem Begin Avenue, Holon 58517, Israel 





Fuil name of ninth inventor, if any 
Amir SHEMER 

Ninth inventor's signature Date 



Residence 

83 Bialik Street, Ramat-Gan 52513, Israel 

Citizenship 

Israel 

Post Office Address 

83 Bialik Street, Ramat-Gan 52513, Israel 



Full name of tenth inventor, if any 
Dan SHKLARSKY 



Tenth inventor's signature Date 



Residence 

9 Yona Angel Street, Haifa 34952, Israel 

Citizenship 

Israel 

Post Office Address 

9 Yona Angel Street, Haifa 34952, Israel 
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Full name of seventh inventor, if any 




Uriel LEVY 




Seventh inventor's signature 


Date 


Residence 

9 Feldman Street, Petach-Tikva 49549, Israel 


Citizenship 




Israel 




Post Office Address 




9 Feldman Street, Petach-Tikva 49549, Israel 







Full name of eighth inventor, if 
Nairn KONFORTI 

Eighth inventor's signature Date 



Residence 

36 Menachem Begin Avenue, Holon 58517, Israel 

Citizenship 

Israel 

Post Office Address 

36 Menachem Begin Avenue, Holon 58517, Israel 



Full name of ninth inventor, if any 
Amir SHEMER 



Ninth inventor's signature 



3 Bialik Street, Ramat-Gan 52513, Israel JT/_£ ^ 



Post Office Address 

83 Bialik Street, Ramat-Gan 52513, Israel 



Full name of tenth inventor, if any 
Dan SHKLARSKY 



Tenth inventor's signature Date 



Residence 

9 Yona Angel Street, Haifa 34952, Israel 

Citizenship 

Israel 



Post Office Address 

9 Yona Angel Street, Haifa 34952, Israel 
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Full nam* Of $evertth inventor, if any 

Uriel LEVY 

Seventh inventor's signature 



Residence 

9 Feldroan Street, Petach-Tikva 49549, Israel 



Citizenship 
Israel 



Post Office Address 

9 Feldman Street, Petach-Tikva 49549, Israel 



Fun name of eighth Inventor, if 
Nairn KONFORTI 



Eighth inventor's signature 



Residence ™~ 

36 Menachem Begin Avenue, Holon 585l7,Israel 



Post Office Address 

36 MenachemBegin Avenue, Helen 5852 7, Israel 



Full nameof ninth inventor, if any 

AmirSKEMER 

Ninth inventor's signature 



Residence 

83 Bialik Street, Raniat-Gan 525l3, IsraeI 
CJttzenshTp 

Israel 

Post Office Adcress ' ~~" ™" 
83 Bialik Street, Ramat-Gan 52513, Israel 



Fuiinam© of terth inventor, if any v A ~ TT 1 , 
CO Dan SHKLARSKY ,. Y PV^ W>PttH -V /7-/-2^L 
! Tenth inventor's signature " * / — J ~* — * 

Residence — — " 
9 Yona AageIStreet 1 Hajfa J 34952, Israel ~JL_X__ J 
Citizenship " 
Israel 

Posi Office Address * " — " — 
9 Yona Angel Street, Haifa 34952, Israel 
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Full name of eleventh inventor, if 
Nadav COHEN 







Eleventh inventor's signature ~" 




/ ' Date 


Residence ~~ 

35 Anatot Street. Tel- Aviv 69080, Tsraol 






umzenship ■ ■ 

Israel 


post Office Address 

35 Anatot Street, Tel-Aviv 69080, Israel 









Full name of twelfth inventor, if 
Twelfth inventor's signature 



Citizenship 

Post Office Address 



Full name of thirteenth inventor, if 
Thirteenth inventor's signature 



Residence 
Citizenship 
Post Office Address 



Full name of fourteenth inventor, if 
Fourteenth inventor's signature 



Residence 
Citizenship 
Post Office Address 
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